Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 11:08:24.860504 22991 test_util.cc:268] Using random seed: 100113108
2026-08-07T11:08:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T11:08:24Z Disabled control of system clock
I20260807 11:08:24.921484 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.254:40237
--webserver_interface=127.22.115.254
--webserver_port=0
--builtin_ntp_servers=127.22.115.212:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260807 11:08:25.227046 23003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:08:25.227818 23003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:08:25.228272 23003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:08:25.259099 23003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:08:25.259434 23003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:08:25.259704 23003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:08:25.259944 23003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:08:25.294457 23003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.254:40237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.115.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:08:25.296391 23003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:08:25.298442 23003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:08:25.323825 23011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:08:25.323921 23014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:08:25.323993 23016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:25.324852 23003 server_base.cc:1034] running on GCE node
I20260807 11:08:26.516880 23003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:08:26.520192 23003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:08:26.521528 23003 hybrid_clock.cc:648] HybridClock initialized: now 1786100906521499 us; error 92 us; skew 500 ppm
I20260807 11:08:26.522711 23003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:08:26.533143 23003 webserver.cc:460] Webserver started at http://127.22.115.254:39051/ using document root <none> and password file <none>
I20260807 11:08:26.534303 23003 fs_manager.cc:359] Metadata directory not provided
I20260807 11:08:26.534508 23003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:08:26.535079 23003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:08:26.540314 23003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data/instance:
uuid: "7e598bda106e4ec181b53fc7f305c822"
format_stamp: "Formatted at 2026-08-07 11:08:26 on dist-test-slave-5bn2"
I20260807 11:08:26.541676 23003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/wal/instance:
uuid: "7e598bda106e4ec181b53fc7f305c822"
format_stamp: "Formatted at 2026-08-07 11:08:26 on dist-test-slave-5bn2"
I20260807 11:08:26.549906 23003 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260807 11:08:26.556283 23026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:26.557760 23003 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260807 11:08:26.558188 23003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/wal
uuid: "7e598bda106e4ec181b53fc7f305c822"
format_stamp: "Formatted at 2026-08-07 11:08:26 on dist-test-slave-5bn2"
I20260807 11:08:26.558530 23003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:08:26.590713 23003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:08:26.592494 23003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:08:26.593024 23003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:08:26.668196 23003 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.254:40237
I20260807 11:08:26.668287 23099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.254:40237 every 8 connection(s)
I20260807 11:08:26.671669 23003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
I20260807 11:08:26.674619 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 23003
I20260807 11:08:26.675203 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-0/wal/instance
I20260807 11:08:26.679078 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.253:40309
--webserver_interface=127.22.115.253
--webserver_port=0
--builtin_ntp_servers=127.22.115.212:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260807 11:08:26.679756 23100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:26.693425 23100 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:08:26.729094 23100 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } has no permanent_uuid. Determining permanent_uuid...
W20260807 11:08:26.731402 23030 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
W20260807 11:08:26.736763 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:40309: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
I20260807 11:08:26.786233 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } attempt: 1
W20260807 11:08:26.790012 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:40309: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
I20260807 11:08:26.858421 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } attempt: 2
W20260807 11:08:26.862263 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:40309: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
I20260807 11:08:26.953653 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } attempt: 3
W20260807 11:08:26.957450 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:40309: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
W20260807 11:08:26.987383 23102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:08:26.987977 23102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:08:26.988416 23102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:08:27.018234 23102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:08:27.018551 23102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:08:27.018795 23102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:08:27.019037 23102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:08:27.052490 23102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.253:40309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.115.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:08:27.053798 23102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:08:27.055424 23102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:08:27.071367 23115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:27.100826 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } attempt: 4
W20260807 11:08:27.104671 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:40309: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
I20260807 11:08:27.404208 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } attempt: 5
W20260807 11:08:27.408080 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:40309: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
I20260807 11:08:27.955585 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } attempt: 6
W20260807 11:08:27.970781 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:40309: Network error: Client connection negotiation failed: client connection to 127.22.115.253:40309: connect: Connection refused (error 111)
W20260807 11:08:27.071595 23114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:27.073549 23102 server_base.cc:1034] running on GCE node
W20260807 11:08:27.071861 23118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:28.325291 23102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:08:28.331565 23102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:08:28.333029 23102 hybrid_clock.cc:648] HybridClock initialized: now 1786100908332995 us; error 51 us; skew 500 ppm
I20260807 11:08:28.333921 23102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:08:28.346946 23102 webserver.cc:460] Webserver started at http://127.22.115.253:36743/ using document root <none> and password file <none>
I20260807 11:08:28.348007 23102 fs_manager.cc:359] Metadata directory not provided
I20260807 11:08:28.348213 23102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:08:28.348685 23102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:08:28.354334 23102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data/instance:
uuid: "18231bef3b524f8ea78d141ae82df928"
format_stamp: "Formatted at 2026-08-07 11:08:28 on dist-test-slave-5bn2"
I20260807 11:08:28.355513 23102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/wal/instance:
uuid: "18231bef3b524f8ea78d141ae82df928"
format_stamp: "Formatted at 2026-08-07 11:08:28 on dist-test-slave-5bn2"
I20260807 11:08:28.366091 23102 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.004s
I20260807 11:08:28.375226 23140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:28.376374 23102 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.007s sys 0.000s
I20260807 11:08:28.376780 23102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/wal
uuid: "18231bef3b524f8ea78d141ae82df928"
format_stamp: "Formatted at 2026-08-07 11:08:28 on dist-test-slave-5bn2"
I20260807 11:08:28.377187 23102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:08:28.444751 23102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:08:28.446789 23102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:08:28.447515 23102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:08:28.676175 23102 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.253:40309
I20260807 11:08:28.677409 23222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.253:40309 every 8 connection(s)
I20260807 11:08:28.680840 23102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/data/info.pb
I20260807 11:08:28.688974 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 23102
I20260807 11:08:28.689437 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-1/wal/instance
I20260807 11:08:28.692759 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:40555
--webserver_interface=127.22.115.252
--webserver_port=0
--builtin_ntp_servers=127.22.115.212:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260807 11:08:28.697975 23224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:28.726768 23224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:08:28.783694 23224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:08:28.818166 23224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } has no permanent_uuid. Determining permanent_uuid...
W20260807 11:08:28.823001 23141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
W20260807 11:08:28.835078 23224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:28.884680 23224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 1
W20260807 11:08:28.890527 23224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:28.958981 23224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 2
W20260807 11:08:28.963624 23224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:29.031286 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } attempt: 7
I20260807 11:08:29.046693 23100 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } has no permanent_uuid. Determining permanent_uuid...
W20260807 11:08:29.053876 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:29.055014 23224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 3
W20260807 11:08:29.060070 23224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:29.112246 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 1
W20260807 11:08:29.116776 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
W20260807 11:08:29.195945 23226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:08:29.196581 23226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:08:29.197029 23226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 11:08:29.198155 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 2
W20260807 11:08:29.202284 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:29.203464 23224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 4
W20260807 11:08:29.207289 23224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
W20260807 11:08:29.228161 23226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:08:29.228444 23226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:08:29.228641 23226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:08:29.228833 23226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:08:29.263222 23226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:40555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.115.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:08:29.264416 23226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:08:29.265986 23226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 11:08:29.287739 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 3
W20260807 11:08:29.294529 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
W20260807 11:08:29.299942 23240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:29.434996 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 4
W20260807 11:08:29.442555 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:29.506817 23224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 5
W20260807 11:08:29.513792 23224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:29.726188 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 5
W20260807 11:08:29.731892 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:30.061507 23224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 6
W20260807 11:08:30.082587 23224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:30.284399 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 6
W20260807 11:08:30.299865 23100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:40555: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
W20260807 11:08:29.300364 23239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:08:29.300133 23243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:08:30.599885 23241 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1297 milliseconds
I20260807 11:08:30.600008 23226 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260807 11:08:30.601361 23226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:08:30.605764 23226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:08:30.607187 23226 hybrid_clock.cc:648] HybridClock initialized: now 1786100910607138 us; error 69 us; skew 500 ppm
I20260807 11:08:30.608088 23226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:08:30.619414 23226 webserver.cc:460] Webserver started at http://127.22.115.252:46049/ using document root <none> and password file <none>
I20260807 11:08:30.620493 23226 fs_manager.cc:359] Metadata directory not provided
I20260807 11:08:30.620692 23226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:08:30.621122 23226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:08:30.626659 23226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/instance:
uuid: "b43b3e5203ee4ac3a23fa1902356994b"
format_stamp: "Formatted at 2026-08-07 11:08:30 on dist-test-slave-5bn2"
I20260807 11:08:30.627875 23226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal/instance:
uuid: "b43b3e5203ee4ac3a23fa1902356994b"
format_stamp: "Formatted at 2026-08-07 11:08:30 on dist-test-slave-5bn2"
I20260807 11:08:30.637182 23226 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260807 11:08:30.645550 23264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:30.646763 23226 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.004s
I20260807 11:08:30.647166 23226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
uuid: "b43b3e5203ee4ac3a23fa1902356994b"
format_stamp: "Formatted at 2026-08-07 11:08:30 on dist-test-slave-5bn2"
I20260807 11:08:30.647501 23226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:08:30.695660 23226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:08:30.698035 23226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:08:30.698643 23226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:08:30.895262 23226 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.252:40555
I20260807 11:08:30.895649 23344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.252:40555 every 8 connection(s)
I20260807 11:08:30.898523 23226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
I20260807 11:08:30.906352 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 23226
I20260807 11:08:30.906875 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal/instance
I20260807 11:08:30.910259 23345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:30.940128 23345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:08:30.977044 23345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:08:30.999742 23345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:08:31.030787 23345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Bootstrap starting.
I20260807 11:08:31.045053 23345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:31.050331 23345 log.cc:824] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Log is configured to *not* fsync() on all Append() calls
I20260807 11:08:31.059300 23345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: No bootstrap required, opened a new log
I20260807 11:08:31.095527 23345 raft_consensus.cc:348] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.096344 23345 raft_consensus.cc:374] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:31.096808 23345 raft_consensus.cc:729] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43b3e5203ee4ac3a23fa1902356994b, State: Initialized, Role: FOLLOWER
I20260807 11:08:31.098309 23345 consensus_queue.cc:260] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.106400 23360 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.107743 23360 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:31.109217 23345 sys_catalog.cc:564] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:08:31.143363 23224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 7
I20260807 11:08:31.184032 23224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: Bootstrap starting.
W20260807 11:08:31.185161 23385 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:08:31.185683 23385 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:08:31.198375 23224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:31.203936 23224 log.cc:824] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: Log is configured to *not* fsync() on all Append() calls
I20260807 11:08:31.170672 23226 master_runner.cc:186] Error getting master registration for 127.22.115.254:40237: OK, instance_id { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" instance_seqno: 1786100906647661 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 11:08:31.208658 23226 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:08:31.210819 23273 tablet.cc:2369] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 11:08:31.219225 23224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: No bootstrap required, opened a new log
I20260807 11:08:31.264721 23224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.265545 23224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:31.265805 23224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18231bef3b524f8ea78d141ae82df928, State: Initialized, Role: FOLLOWER
I20260807 11:08:31.266753 23224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.273113 23389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.274371 23389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:31.276036 23224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:08:31.333472 23100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } attempt: 7
W20260807 11:08:31.376366 23417 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:08:31.376856 23417 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:08:31.400580 23100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Bootstrap starting.
I20260807 11:08:31.363792 23102 master_runner.cc:186] Error getting master registration for 127.22.115.254:40237: OK, instance_id { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" instance_seqno: 1786100906647661 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 11:08:31.407245 23102 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:08:31.413206 23100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:31.417430 23100 log.cc:824] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Log is configured to *not* fsync() on all Append() calls
I20260807 11:08:31.431771 23100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: No bootstrap required, opened a new log
W20260807 11:08:31.464296 23148 tablet.cc:2369] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 11:08:31.493710 23100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.495225 23100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:31.495736 23100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e598bda106e4ec181b53fc7f305c822, State: Initialized, Role: FOLLOWER
I20260807 11:08:31.497308 23100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.504367 23422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.505853 23422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:31.507738 23100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:08:31.581120 23360 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:31.581998 23360 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.588953 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:31.590667 23065 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43b3e5203ee4ac3a23fa1902356994b in term 0.
I20260807 11:08:31.593083 23269 leader_election.cc:302] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b; no voters:
I20260807 11:08:31.601645 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:31.603179 23188 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43b3e5203ee4ac3a23fa1902356994b in term 0.
W20260807 11:08:31.605508 23033 tablet.cc:2369] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 11:08:31.619060 23360 leader_election.cc:288] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309)
I20260807 11:08:31.619963 23360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:31.620515 23360 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:31.621127 23360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:31.646209 23360 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.661922 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822"
I20260807 11:08:31.662714 23065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:31.664376 23360 leader_election.cc:288] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 1 election: Requested vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309)
I20260807 11:08:31.668610 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928"
I20260807 11:08:31.669338 23188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:31.682626 23065 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43b3e5203ee4ac3a23fa1902356994b in term 1.
I20260807 11:08:31.688683 23188 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43b3e5203ee4ac3a23fa1902356994b in term 1.
I20260807 11:08:31.690709 23269 leader_election.cc:302] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b; no voters:
I20260807 11:08:31.692158 23360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:31.692826 23360 raft_consensus.cc:686] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 1 LEADER]: Becoming Leader. State: Replica: b43b3e5203ee4ac3a23fa1902356994b, State: Running, Role: LEADER
I20260807 11:08:31.694600 23360 consensus_queue.cc:237] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:31.721335 23440 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43b3e5203ee4ac3a23fa1902356994b. Latest consensus state: current_term: 1 leader_uuid: "b43b3e5203ee4ac3a23fa1902356994b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.722371 23440 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: LEADER
I20260807 11:08:31.735644 23445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260807 11:08:31.750442 23442 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:08:31.750880 23442 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:08:31.759459 23445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 11:08:31.824410 23188 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Refusing update from remote peer b43b3e5203ee4ac3a23fa1902356994b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 11:08:31.825218 23065 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Refusing update from remote peer b43b3e5203ee4ac3a23fa1902356994b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 11:08:31.827131 23440 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:31.830633 23360 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:31.914247 23422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43b3e5203ee4ac3a23fa1902356994b. Latest consensus state: current_term: 1 leader_uuid: "b43b3e5203ee4ac3a23fa1902356994b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.915257 23422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:31.929812 23451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43b3e5203ee4ac3a23fa1902356994b. Latest consensus state: current_term: 1 leader_uuid: "b43b3e5203ee4ac3a23fa1902356994b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.935524 23451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:31.947826 23454 mvcc.cc:205] Tried to move back new op lower bound from 7315869334801498112 to 7315869334318759936. Current Snapshot: MvccSnapshot[applied={T|T < 7315869334801498112}]
I20260807 11:08:31.952940 23422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b43b3e5203ee4ac3a23fa1902356994b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.954095 23422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:31.968050 23440 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b43b3e5203ee4ac3a23fa1902356994b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.969260 23440 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: LEADER
I20260807 11:08:31.979053 23451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b43b3e5203ee4ac3a23fa1902356994b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:31.980257 23451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:31.988691 23445 catalog_manager.cc:1347] Generated new cluster ID: 1fc1be4dcf034633aaea4c03e0988a11
I20260807 11:08:31.989094 23445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 11:08:32.000140 23440 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b43b3e5203ee4ac3a23fa1902356994b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:32.001221 23440 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: LEADER
I20260807 11:08:32.040331 23445 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 11:08:32.044395 23445 catalog_manager.cc:1504] Loading token signing keys...
I20260807 11:08:32.122905 23445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Generated new TSK 0
I20260807 11:08:32.124781 23445 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 11:08:32.185209 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.115.193:0
--local_ip_for_outbound_sockets=127.22.115.193
--webserver_interface=127.22.115.193
--webserver_port=0
--tserver_master_addrs=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--builtin_ntp_servers=127.22.115.212:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260807 11:08:32.387087 23417 catalog_manager.cc:1259] Loaded cluster ID: 1fc1be4dcf034633aaea4c03e0988a11
I20260807 11:08:32.387501 23417 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: loading cluster ID for follower catalog manager: success
I20260807 11:08:32.424964 23417 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: acquiring CA information for follower catalog manager: success
I20260807 11:08:32.436679 23417 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 11:08:32.758628 23442 catalog_manager.cc:1259] Loaded cluster ID: 1fc1be4dcf034633aaea4c03e0988a11
I20260807 11:08:32.759027 23442 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: loading cluster ID for follower catalog manager: success
I20260807 11:08:32.798378 23442 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: acquiring CA information for follower catalog manager: success
I20260807 11:08:32.831209 23442 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 11:08:33.091833 23473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:33.092547 23473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:33.096717 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:33.110222 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:33.113301 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:33.118410 23473 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:33.119851 23473 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:08:33.154969 23466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:08:33.155728 23466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:08:33.156742 23466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:08:33.216861 23466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:08:33.218568 23466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.115.193
I20260807 11:08:33.282373 23466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.115.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.115.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.115.193
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:08:33.284667 23466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:08:33.287108 23466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:08:33.376863 23479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:33.885080 23485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:33.887383 23485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:33.903587 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:33.904747 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:33.907769 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:33.909667 23485 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:33.910408 23485 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:34.451828 23487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:34.452589 23487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:34.464604 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:34.468505 23487 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:34.469514 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:34.471611 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:34.472617 23487 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:34.575495 23488 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:34.577179 23488 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:34.587466 23488 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:34.588624 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:34.591116 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:34.594412 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:34.595656 23488 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:35.456193 23493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:35.457418 23493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:35.471004 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:35.472352 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:35.474115 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:35.479336 23493 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:35.481220 23493 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:35.693482 23495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:35.694074 23495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:35.697120 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:35.701627 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:35.703109 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:35.706944 23495 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:35.707506 23495 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:08:33.377347 23477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:08:35.816598 23466 thread.cc:636] OpenStack (cloud detector) Time spent creating pthread: real 2.447s user 0.720s sys 0.938s
W20260807 11:08:34.738792 23476 debug-util.cc:398] Leaking SignalData structure 0x7b08000148c0 after lost signal to thread 23466
W20260807 11:08:35.818364 23466 thread.cc:602] OpenStack (cloud detector) Time spent starting thread: real 2.449s user 0.720s sys 0.939s
W20260807 11:08:35.817477 23480 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2450 milliseconds
I20260807 11:08:35.819036 23466 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260807 11:08:35.819125 23482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:35.824292 23466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:08:35.827045 23466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:08:35.828522 23466 hybrid_clock.cc:648] HybridClock initialized: now 1786100915828451 us; error 73 us; skew 500 ppm
I20260807 11:08:35.829615 23466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:08:35.840627 23466 webserver.cc:460] Webserver started at http://127.22.115.193:37005/ using document root <none> and password file <none>
I20260807 11:08:35.841921 23466 fs_manager.cc:359] Metadata directory not provided
I20260807 11:08:35.842259 23466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:08:35.842890 23466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:08:35.849871 23466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data/instance:
uuid: "8a668588fabb4a9eba107cd6020f1e93"
format_stamp: "Formatted at 2026-08-07 11:08:35 on dist-test-slave-5bn2"
I20260807 11:08:35.851482 23466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/instance:
uuid: "8a668588fabb4a9eba107cd6020f1e93"
format_stamp: "Formatted at 2026-08-07 11:08:35 on dist-test-slave-5bn2"
I20260807 11:08:35.861019 23466 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.002s
I20260807 11:08:35.870221 23506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:35.871516 23466 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.005s
I20260807 11:08:35.872052 23466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal
uuid: "8a668588fabb4a9eba107cd6020f1e93"
format_stamp: "Formatted at 2026-08-07 11:08:35 on dist-test-slave-5bn2"
I20260807 11:08:35.872588 23466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:08:35.957647 23466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:08:35.960799 23466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:08:35.961470 23466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:08:35.967342 23466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 11:08:35.976023 23466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 11:08:35.976316 23466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:35.976600 23466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 11:08:35.976770 23466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:36.069831 23547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:36.070695 23547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:36.074828 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:36.076196 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:36.078598 23547 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:36.078693 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:36.080098 23547 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:36.435220 23466 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.193:37453
I20260807 11:08:36.435717 23687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.193:37453 every 8 connection(s)
I20260807 11:08:36.438047 23466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/data/info.pb
I20260807 11:08:36.439960 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 23466
I20260807 11:08:36.441295 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/instance
I20260807 11:08:36.464071 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.115.194:0
--local_ip_for_outbound_sockets=127.22.115.194
--webserver_interface=127.22.115.194
--webserver_port=0
--tserver_master_addrs=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--builtin_ntp_servers=127.22.115.212:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260807 11:08:36.518946 23691 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:36.519438 23691 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:36.521075 23691 heartbeater.cc:511] Master 127.22.115.252:40555 requested a full tablet report, sending...
I20260807 11:08:36.521203 23690 heartbeater.cc:347] Connected to a master server at 127.22.115.253:40309
I20260807 11:08:36.521692 23690 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:36.523279 23690 heartbeater.cc:511] Master 127.22.115.253:40309 requested a full tablet report, sending...
I20260807 11:08:36.525974 23696 heartbeater.cc:347] Connected to a master server at 127.22.115.254:40237
I20260807 11:08:36.526432 23696 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:36.526958 23294 ts_manager.cc:194] Registered new tserver with Master: 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:36.527899 23696 heartbeater.cc:511] Master 127.22.115.254:40237 requested a full tablet report, sending...
I20260807 11:08:36.527984 23164 ts_manager.cc:194] Registered new tserver with Master: 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:36.531617 23294 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.115.193:39611
I20260807 11:08:36.532359 23046 ts_manager.cc:194] Registered new tserver with Master: 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:36.627149 23705 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:36.627804 23705 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:36.630342 23705 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:36.631482 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:36.631747 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:36.633652 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:36.634706 23705 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:36.695981 23706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:36.697134 23706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:36.703399 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:36.703672 23706 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:36.705219 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:36.706707 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:36.707752 23706 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:37.037599 23691 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
W20260807 11:08:37.042591 23703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:08:37.043121 23703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:08:37.043708 23703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:08:37.075394 23703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:08:37.076380 23703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.115.194
I20260807 11:08:37.111795 23703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.115.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.115.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.115.194
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:08:37.113070 23703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:08:37.114820 23703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:08:37.134904 23716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:37.177042 23724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:37.177536 23724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:37.179230 23724 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:37.180456 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:37.180317 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:37.182063 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:37.182946 23724 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:37.705117 23726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:37.705627 23726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:37.707371 23726 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:37.708591 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:37.708591 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:37.710232 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:37.710932 23726 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:37.800427 23727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:37.800895 23727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:37.802476 23727 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:37.803535 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:37.803390 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:37.805049 23030 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:37.805896 23727 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:08:37.134950 23717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:37.137055 23703 server_base.cc:1034] running on GCE node
W20260807 11:08:37.134915 23720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:38.241395 23703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:08:38.244503 23703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:08:38.245888 23703 hybrid_clock.cc:648] HybridClock initialized: now 1786100918245853 us; error 44 us; skew 500 ppm
I20260807 11:08:38.246816 23703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:08:38.264635 23703 webserver.cc:460] Webserver started at http://127.22.115.194:41439/ using document root <none> and password file <none>
I20260807 11:08:38.265749 23703 fs_manager.cc:359] Metadata directory not provided
I20260807 11:08:38.265972 23703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:08:38.266484 23703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:08:38.273022 23703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data/instance:
uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
format_stamp: "Formatted at 2026-08-07 11:08:38 on dist-test-slave-5bn2"
I20260807 11:08:38.274360 23703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/instance:
uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
format_stamp: "Formatted at 2026-08-07 11:08:38 on dist-test-slave-5bn2"
I20260807 11:08:38.287006 23703 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.002s sys 0.009s
I20260807 11:08:38.288758 23736 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:38.289366 23736 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:38.292887 23736 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:38.293972 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:38.294111 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:38.295521 23737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:38.295979 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:38.296799 23736 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:38.296962 23703 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260807 11:08:38.297322 23703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal
uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
format_stamp: "Formatted at 2026-08-07 11:08:38 on dist-test-slave-5bn2"
I20260807 11:08:38.297672 23703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:08:38.361276 23703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:08:38.364630 23703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:08:38.365487 23703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:08:38.373035 23703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 11:08:38.382222 23703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 11:08:38.382556 23703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:38.382944 23703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 11:08:38.383101 23703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:38.411754 23753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:38.412533 23753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:38.418269 23753 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:38.418324 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:38.419574 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:38.421972 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:38.423867 23753 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:38.869692 23864 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:38.870644 23864 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:38.876124 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:38.877856 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:38.879117 23864 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:38.879511 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:38.880254 23864 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:39.005239 23703 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.194:39497
I20260807 11:08:39.005626 23911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.194:39497 every 8 connection(s)
I20260807 11:08:39.008280 23703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/data/info.pb
I20260807 11:08:39.011476 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 23703
I20260807 11:08:39.011952 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/instance
I20260807 11:08:39.044565 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.115.195:0
--local_ip_for_outbound_sockets=127.22.115.195
--webserver_interface=127.22.115.195
--webserver_port=0
--tserver_master_addrs=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--builtin_ntp_servers=127.22.115.212:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260807 11:08:39.108052 23913 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:39.108644 23913 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:39.110668 23913 heartbeater.cc:511] Master 127.22.115.252:40555 requested a full tablet report, sending...
I20260807 11:08:39.113494 23917 heartbeater.cc:347] Connected to a master server at 127.22.115.254:40237
I20260807 11:08:39.113938 23917 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:39.115607 23917 heartbeater.cc:511] Master 127.22.115.254:40237 requested a full tablet report, sending...
I20260807 11:08:39.115736 23294 ts_manager.cc:194] Registered new tserver with Master: 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:39.118456 23912 heartbeater.cc:347] Connected to a master server at 127.22.115.253:40309
I20260807 11:08:39.118834 23912 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:39.120267 23912 heartbeater.cc:511] Master 127.22.115.253:40309 requested a full tablet report, sending...
I20260807 11:08:39.120750 23046 ts_manager.cc:194] Registered new tserver with Master: 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:39.123131 23294 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.115.194:52287
I20260807 11:08:39.126830 23164 ts_manager.cc:194] Registered new tserver with Master: 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:39.413995 23922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:08:39.414515 23922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:08:39.415411 23922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 11:08:39.431396 23932 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:39.431970 23932 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:39.434376 23932 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:39.434924 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:39.435545 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:39.437351 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:39.438194 23932 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:08:39.452061 23922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:08:39.453007 23922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.115.195
I20260807 11:08:39.489308 23922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.115.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.115.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.115.195
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:08:39.490586 23922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:08:39.492280 23922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:08:39.511034 23939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:39.631892 23913 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:40.466019 23942 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:40.466568 23942 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:40.470114 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:40.470229 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:40.472234 23942 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:40.472631 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e598bda106e4ec181b53fc7f305c822; no voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:40.473623 23942 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:40.616314 23943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:40.617043 23943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:40.620592 23943 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:40.621919 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:40.622407 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:40.624454 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:40.625527 23943 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:08:39.511183 23937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:08:39.512084 23934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:08:40.755029 23938 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260807 11:08:40.755162 23922 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260807 11:08:40.759157 23922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:08:40.763487 23922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:08:40.764878 23922 hybrid_clock.cc:648] HybridClock initialized: now 1786100920764851 us; error 44 us; skew 500 ppm
I20260807 11:08:40.765738 23922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:08:40.779451 23922 webserver.cc:460] Webserver started at http://127.22.115.195:33009/ using document root <none> and password file <none>
I20260807 11:08:40.780480 23922 fs_manager.cc:359] Metadata directory not provided
I20260807 11:08:40.780700 23922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:08:40.781193 23922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:08:40.787570 23922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data/instance:
uuid: "c281254655c84a0496c50045c37b22df"
format_stamp: "Formatted at 2026-08-07 11:08:40 on dist-test-slave-5bn2"
I20260807 11:08:40.788761 23922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/instance:
uuid: "c281254655c84a0496c50045c37b22df"
format_stamp: "Formatted at 2026-08-07 11:08:40 on dist-test-slave-5bn2"
I20260807 11:08:40.799203 23922 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.005s
I20260807 11:08:40.808226 23950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:40.809474 23922 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.003s
I20260807 11:08:40.809903 23922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal
uuid: "c281254655c84a0496c50045c37b22df"
format_stamp: "Formatted at 2026-08-07 11:08:40 on dist-test-slave-5bn2"
I20260807 11:08:40.810292 23922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:08:40.863991 23922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:08:40.866585 23922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:08:40.867188 23922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:08:40.872290 23922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 11:08:40.881336 23922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 11:08:40.881570 23922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:40.881843 23922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 11:08:40.881996 23922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:41.167704 24038 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:41.168488 24038 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:41.172901 24038 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:41.173098 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:41.173696 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:41.175431 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:41.176271 24038 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:41.418737 23922 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.195:36683
I20260807 11:08:41.419229 24114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.195:36683 every 8 connection(s)
I20260807 11:08:41.422212 23922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/data/info.pb
I20260807 11:08:41.425737 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 23922
I20260807 11:08:41.426216 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/instance
I20260807 11:08:41.530253 24118 heartbeater.cc:347] Connected to a master server at 127.22.115.253:40309
I20260807 11:08:41.531033 24118 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:41.533417 24118 heartbeater.cc:511] Master 127.22.115.253:40309 requested a full tablet report, sending...
I20260807 11:08:41.538822 23164 ts_manager.cc:194] Registered new tserver with Master: c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:41.544910 24127 heartbeater.cc:347] Connected to a master server at 127.22.115.254:40237
I20260807 11:08:41.545476 24127 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:41.547227 24127 heartbeater.cc:511] Master 127.22.115.254:40237 requested a full tablet report, sending...
I20260807 11:08:41.549185 24119 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:41.549630 24119 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:41.551427 23046 ts_manager.cc:194] Registered new tserver with Master: c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:41.551601 24119 heartbeater.cc:511] Master 127.22.115.252:40555 requested a full tablet report, sending...
I20260807 11:08:41.555717 23294 ts_manager.cc:194] Registered new tserver with Master: c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:41.559031 23294 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.115.195:40201
I20260807 11:08:41.572585 22991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 11:08:41.713837 24141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:41.714633 24141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:41.718773 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:41.718698 24141 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:41.720646 23311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:41.722954 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:41.724140 24141 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:41.748684 23296 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60456:
name: "default.Table_d42bf9cc4fdc4d478f2da5c6aa7b21a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:41.747290 23294 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60456:
name: "default.Table_6dfbf324722d46f5a3f27e66ca70b8c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:41.760525 23296 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d42bf9cc4fdc4d478f2da5c6aa7b21a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:41.767210 23294 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dfbf324722d46f5a3f27e66ca70b8c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:41.772120 23293 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60456:
name: "default.Table_179c7d3a61fa488a8941a27b63864037"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:41.772562 23290 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60456:
name: "default.Table_ab5ac45b9a6a4be1a2d30913abcd6d62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:41.776062 23293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_179c7d3a61fa488a8941a27b63864037 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:41.776789 23290 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab5ac45b9a6a4be1a2d30913abcd6d62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:41.942817 23290 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60456:
table { table_name: "default.Table_d42bf9cc4fdc4d478f2da5c6aa7b21a5" } new_table_name: "default.Table_250a3f4487f94d5c8dea2acabb1593ad" modify_external_catalogs: true
I20260807 11:08:41.943462 23296 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60456:
table { table_name: "default.Table_ab5ac45b9a6a4be1a2d30913abcd6d62" } new_table_name: "default.Table_cf60aa5975bf40ebaf6212fbba7d30bd" modify_external_catalogs: true
W20260807 11:08:41.999404 23296 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ea8afa8842d41a48906848279cb6480 has no consensus state
I20260807 11:08:42.006708 23296 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60456:
table { table_name: "default.Table_6dfbf324722d46f5a3f27e66ca70b8c4" } modify_external_catalogs: true
I20260807 11:08:42.007522 23296 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60456:
table { table_name: "default.Table_6dfbf324722d46f5a3f27e66ca70b8c4" } modify_external_catalogs: true
I20260807 11:08:42.008780 23294 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60456:
table { table_name: "default.Table_cf60aa5975bf40ebaf6212fbba7d30bd" } modify_external_catalogs: true
I20260807 11:08:42.009270 23294 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60456:
table { table_name: "default.Table_cf60aa5975bf40ebaf6212fbba7d30bd" } modify_external_catalogs: true
I20260807 11:08:42.014029 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 23226
W20260807 11:08:42.050252 23027 connection.cc:535] server connection from 127.0.0.1:40234 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 11:08:42.066167 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
W20260807 11:08:42.069733 24119 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:40555 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
W20260807 11:08:42.089834 23691 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:40555 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
W20260807 11:08:42.175405 23913 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:40555 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:42.497682 24200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:42.498103 24200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:42.499787 24200 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:42.500728 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:08:42.502364 23141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260807 11:08:42.505399 23141 leader_election.cc:334] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:42.505903 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:42.506661 24200 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:08:42.520893 24204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:42.521317 24204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:42.523144 24204 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:42.524072 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:42.524757 23188 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e598bda106e4ec181b53fc7f305c822 in term 1.
W20260807 11:08:42.526024 23027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111) [suppressed 13 similar messages]
I20260807 11:08:42.525949 23030 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822; no voters:
I20260807 11:08:42.526878 24204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 11:08:42.527259 24204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b43b3e5203ee4ac3a23fa1902356994b)
I20260807 11:08:42.527598 24204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 1 FOLLOWER]: Advancing to term 2
W20260807 11:08:42.529975 23027 leader_election.cc:334] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:42.536342 24204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:42.538540 24204 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 election: Requested vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:42.539362 23188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928"
I20260807 11:08:42.539845 23188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 1 FOLLOWER]: Advancing to term 2
W20260807 11:08:42.542258 23027 leader_election.cc:334] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:42.546223 23188 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e598bda106e4ec181b53fc7f305c822 in term 2.
I20260807 11:08:42.547135 23030 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822; no voters: b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:42.547840 24204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 11:08:42.549060 24204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 2 LEADER]: Becoming Leader. State: Replica: 7e598bda106e4ec181b53fc7f305c822, State: Running, Role: LEADER
I20260807 11:08:42.550148 24204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:42.554272 24211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e598bda106e4ec181b53fc7f305c822. Latest consensus state: current_term: 2 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:42.554904 24211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: LEADER
W20260807 11:08:43.025991 23027 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 -> Peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Couldn't send request to peer b43b3e5203ee4ac3a23fa1902356994b. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:43.039269 23188 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Refusing update from remote peer 7e598bda106e4ec181b53fc7f305c822: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 11:08:43.040526 24211 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 11:08:43.047394 24216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e598bda106e4ec181b53fc7f305c822. Latest consensus state: current_term: 2 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:43.047966 24216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:43.057300 24211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:43.058048 24211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: LEADER
I20260807 11:08:43.058835 24216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:43.059687 24216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:43.074355 24212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 11:08:43.083283 24212 catalog_manager.cc:669] Loaded metadata for table default.Table_6dfbf324722d46f5a3f27e66ca70b8c4 [id=052771a4903840e8a99e41fae8c17ce6]
I20260807 11:08:43.084790 24212 catalog_manager.cc:669] Loaded metadata for table default.Table_cf60aa5975bf40ebaf6212fbba7d30bd [id=c838bbc9dbdb4bb3a6f719666bb70232]
I20260807 11:08:43.086097 24212 catalog_manager.cc:669] Loaded metadata for table default.Table_179c7d3a61fa488a8941a27b63864037 [id=d649529acb514800845ee14d0803f79c]
I20260807 11:08:43.087436 24212 catalog_manager.cc:669] Loaded metadata for table default.Table_250a3f4487f94d5c8dea2acabb1593ad [id=d96069ebf6b34dca829261fa6320aafc]
I20260807 11:08:43.093112 24212 tablet_loader.cc:96] loaded metadata for tablet 08e14760bfd548308d8c71096964087a (table default.Table_250a3f4487f94d5c8dea2acabb1593ad [id=d96069ebf6b34dca829261fa6320aafc])
I20260807 11:08:43.093900 24212 tablet_loader.cc:96] loaded metadata for tablet 1f3d4571045043eb8ec87b5f31871a09 (table default.Table_179c7d3a61fa488a8941a27b63864037 [id=d649529acb514800845ee14d0803f79c])
I20260807 11:08:43.096455 24212 tablet_loader.cc:96] loaded metadata for tablet 4e60df14ee294fe38e828ec50e48fd49 (table default.Table_6dfbf324722d46f5a3f27e66ca70b8c4 [id=052771a4903840e8a99e41fae8c17ce6])
I20260807 11:08:43.097687 24212 tablet_loader.cc:96] loaded metadata for tablet 4ea8afa8842d41a48906848279cb6480 (table default.Table_cf60aa5975bf40ebaf6212fbba7d30bd [id=c838bbc9dbdb4bb3a6f719666bb70232])
I20260807 11:08:43.099176 24212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 11:08:43.104451 24212 catalog_manager.cc:1259] Loaded cluster ID: 1fc1be4dcf034633aaea4c03e0988a11
I20260807 11:08:43.104740 24212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 11:08:43.109903 24212 catalog_manager.cc:1504] Loading token signing keys...
I20260807 11:08:43.114030 24212 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Loaded TSK: 0
I20260807 11:08:43.115471 24212 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 11:08:43.229105 22997 debug-util.cc:398] Leaking SignalData structure 0x7b080002a0c0 after lost signal to thread 24134
W20260807 11:08:42.053428 24134 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.22.115.252:40555)
W20260807 11:08:43.355008 22997 kernel_stack_watchdog.cc:198] Thread 24134 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/outbound_call.cc:308 for 178ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260807 11:08:43.355154 24134 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.DeleteTable -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 1.30556e+06us
I20260807 11:08:43.356145 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:40555
--webserver_interface=127.22.115.252
--webserver_port=46049
--builtin_ntp_servers=127.22.115.212:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260807 11:08:43.356264 24134 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.22.115.252:40555)
W20260807 11:08:43.365873 24134 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.115.252:40555)
W20260807 11:08:43.367278 24134 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.22.115.252:40555)
I20260807 11:08:43.386451 23046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6dfbf324722d46f5a3f27e66ca70b8c4" } modify_external_catalogs: true
I20260807 11:08:43.388970 23043 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_d42bf9cc4fdc4d478f2da5c6aa7b21a5" } new_table_name: "default.Table_250a3f4487f94d5c8dea2acabb1593ad" modify_external_catalogs: true
I20260807 11:08:43.415828 23046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6dfbf324722d46f5a3f27e66ca70b8c4" } modify_external_catalogs: true
I20260807 11:08:43.391716 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_1464bf48282c42ae9b47093453f7db96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:43.390390 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_a6f456ed13f54602ae1020b7ffb1c746"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:43.387601 23048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_cf60aa5975bf40ebaf6212fbba7d30bd" } modify_external_catalogs: true
I20260807 11:08:43.388577 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_179c7d3a61fa488a8941a27b63864037"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:43.418279 23048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_cf60aa5975bf40ebaf6212fbba7d30bd" } modify_external_catalogs: true
I20260807 11:08:43.390043 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_be7bacfa004649b79d2785223c582304"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:43.420681 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be7bacfa004649b79d2785223c582304 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:43.421886 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_179c7d3a61fa488a8941a27b63864037 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:43.423748 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6f456ed13f54602ae1020b7ffb1c746 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:43.429075 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1464bf48282c42ae9b47093453f7db96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:43.429388 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_ed6001fd32544668bfdec9960e66fd5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:43.431819 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed6001fd32544668bfdec9960e66fd5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:43.439618 23046 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 4e60df14ee294fe38e828ec50e48fd49
I20260807 11:08:43.463485 23048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 4ea8afa8842d41a48906848279cb6480
I20260807 11:08:43.507577 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea8afa8842d41a48906848279cb6480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:43.521368 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 4ea8afa8842d41a48906848279cb6480 because the tablet was not found. No further retry: Not found: Tablet not found: 4ea8afa8842d41a48906848279cb6480
I20260807 11:08:43.526757 23583 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea8afa8842d41a48906848279cb6480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:43.533668 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_be7bacfa004649b79d2785223c582304" } new_table_name: "default.Table_4ea089dc2f224c50b572756022203a08" modify_external_catalogs: true
I20260807 11:08:43.533878 23040 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_ed6001fd32544668bfdec9960e66fd5d" } new_table_name: "default.Table_48a68415bdce41348c38732cfe17762d" modify_external_catalogs: true
I20260807 11:08:43.526793 24022 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea8afa8842d41a48906848279cb6480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:43.550372 23030 catalog_manager.cc:4808] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 4ea8afa8842d41a48906848279cb6480 because the tablet was not found. No further retry: Not found: Tablet not found: 4ea8afa8842d41a48906848279cb6480
W20260807 11:08:43.553619 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 4ea8afa8842d41a48906848279cb6480 because the tablet was not found. No further retry: Not found: Tablet not found: 4ea8afa8842d41a48906848279cb6480
W20260807 11:08:43.577284 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69df15a9057c4a9597b6239a33920950 consensus state has no leader
I20260807 11:08:43.579583 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 (DEFAULT_TABLE table=default.Table_a6f456ed13f54602ae1020b7ffb1c746 [id=022b0768d03845f89e05a4206d49ff01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.583890 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5505cb8da7ce474ea3a8dff33ea0af56. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:43.591270 23040 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46dcd20b44b2493b84ef115a546ef215 consensus state has no leader
I20260807 11:08:43.591290 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3d4571045043eb8ec87b5f31871a09 (DEFAULT_TABLE table=default.Table_179c7d3a61fa488a8941a27b63864037 [id=d649529acb514800845ee14d0803f79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.593021 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3d4571045043eb8ec87b5f31871a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.596124 23813 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3d4571045043eb8ec87b5f31871a09 (DEFAULT_TABLE table=default.Table_179c7d3a61fa488a8941a27b63864037 [id=d649529acb514800845ee14d0803f79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.596402 23816 tablet_service.cc:1467] Processing CreateTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 (DEFAULT_TABLE table=default.Table_1464bf48282c42ae9b47093453f7db96 [id=4c7601a951374a9aa81371462d6bc20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.596762 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 46dcd20b44b2493b84ef115a546ef215 (DEFAULT_TABLE table=default.Table_48a68415bdce41348c38732cfe17762d [id=1d96f575ea9747ca9ffcffe946c858ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.588991 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 (DEFAULT_TABLE table=default.Table_1464bf48282c42ae9b47093453f7db96 [id=4c7601a951374a9aa81371462d6bc20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.597824 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46dcd20b44b2493b84ef115a546ef215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.598052 23813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3d4571045043eb8ec87b5f31871a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.598793 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 612c4e9a831f41ddb3304ad0f9a7c949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.599742 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 46dcd20b44b2493b84ef115a546ef215 (DEFAULT_TABLE table=default.Table_48a68415bdce41348c38732cfe17762d [id=1d96f575ea9747ca9ffcffe946c858ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.600133 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 69df15a9057c4a9597b6239a33920950 (DEFAULT_TABLE table=default.Table_4ea089dc2f224c50b572756022203a08 [id=3093745fb4e34d2b9ecc5b93ac6deb97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.600574 23816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 612c4e9a831f41ddb3304ad0f9a7c949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.601230 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69df15a9057c4a9597b6239a33920950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.603003 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 69df15a9057c4a9597b6239a33920950 (DEFAULT_TABLE table=default.Table_4ea089dc2f224c50b572756022203a08 [id=3093745fb4e34d2b9ecc5b93ac6deb97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.604117 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69df15a9057c4a9597b6239a33920950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.606278 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46dcd20b44b2493b84ef115a546ef215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.610080 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 (DEFAULT_TABLE table=default.Table_a6f456ed13f54602ae1020b7ffb1c746 [id=022b0768d03845f89e05a4206d49ff01]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:43.617365 23030 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 69df15a9057c4a9597b6239a33920950 (table default.Table_4ea089dc2f224c50b572756022203a08 [id=3093745fb4e34d2b9ecc5b93ac6deb97], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 69df15a9057c4a9597b6239a33920950 consensus state has no leader
I20260807 11:08:43.621403 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5505cb8da7ce474ea3a8dff33ea0af56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.632946 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 (DEFAULT_TABLE table=default.Table_a6f456ed13f54602ae1020b7ffb1c746 [id=022b0768d03845f89e05a4206d49ff01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.634264 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5505cb8da7ce474ea3a8dff33ea0af56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.643232 23041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4ea089dc2f224c50b572756022203a08" } modify_external_catalogs: true
I20260807 11:08:43.643788 23041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4ea089dc2f224c50b572756022203a08" } modify_external_catalogs: true
I20260807 11:08:43.592770 24021 tablet_service.cc:1467] Processing CreateTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 (DEFAULT_TABLE table=default.Table_1464bf48282c42ae9b47093453f7db96 [id=4c7601a951374a9aa81371462d6bc20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.620105 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3d4571045043eb8ec87b5f31871a09 (DEFAULT_TABLE table=default.Table_179c7d3a61fa488a8941a27b63864037 [id=d649529acb514800845ee14d0803f79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.620656 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 46dcd20b44b2493b84ef115a546ef215 (DEFAULT_TABLE table=default.Table_48a68415bdce41348c38732cfe17762d [id=1d96f575ea9747ca9ffcffe946c858ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.622570 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 69df15a9057c4a9597b6239a33920950 (DEFAULT_TABLE table=default.Table_4ea089dc2f224c50b572756022203a08 [id=3093745fb4e34d2b9ecc5b93ac6deb97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.661296 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46dcd20b44b2493b84ef115a546ef215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.664861 23917 heartbeater.cc:503] Master 127.22.115.254:40237 was elected leader, sending a full tablet report...
I20260807 11:08:43.667052 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3d4571045043eb8ec87b5f31871a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.674144 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 612c4e9a831f41ddb3304ad0f9a7c949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.675562 23041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 69df15a9057c4a9597b6239a33920950
I20260807 11:08:43.676163 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69df15a9057c4a9597b6239a33920950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.678865 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet 69df15a9057c4a9597b6239a33920950 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:43.681281 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 69df15a9057c4a9597b6239a33920950 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:43.683892 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 69df15a9057c4a9597b6239a33920950 because the tablet was not found. No further retry: Not found: Tablet not found: 69df15a9057c4a9597b6239a33920950
I20260807 11:08:43.696658 24262 tablet_bootstrap.cc:492] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:43.708180 23030 catalog_manager.cc:4808] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 69df15a9057c4a9597b6239a33920950 because the tablet was not found. No further retry: Not found: Tablet not found: 69df15a9057c4a9597b6239a33920950
I20260807 11:08:43.708408 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_1464bf48282c42ae9b47093453f7db96" } modify_external_catalogs: true
I20260807 11:08:43.709136 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_1464bf48282c42ae9b47093453f7db96" } modify_external_catalogs: true
I20260807 11:08:43.722229 24262 tablet_bootstrap.cc:654] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:43.724663 24262 log.cc:824] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Log is configured to *not* fsync() on all Append() calls
I20260807 11:08:43.725868 23040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 612c4e9a831f41ddb3304ad0f9a7c949
I20260807 11:08:43.728374 23816 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:43.729884 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 612c4e9a831f41ddb3304ad0f9a7c949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 612c4e9a831f41ddb3304ad0f9a7c949 already in progress: creating tablet
I20260807 11:08:43.731436 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_1c6713370c9f41ba91509a0773101822"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:43.733297 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c6713370c9f41ba91509a0773101822 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:43.735347 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_83665ed20c9240c790c6ebe6ca706e6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:43.736887 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83665ed20c9240c790c6ebe6ca706e6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:43.738772 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_64cd1665df804462ba5435d0610f528d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:43.740310 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64cd1665df804462ba5435d0610f528d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:43.743431 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_ae9352e0450a4060933195affdc6e2d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:43.745150 24261 tablet_bootstrap.cc:492] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:43.746366 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:43.749675 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 69df15a9057c4a9597b6239a33920950 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:43.751106 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae9352e0450a4060933195affdc6e2d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:43.750761 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 612c4e9a831f41ddb3304ad0f9a7c949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 612c4e9a831f41ddb3304ad0f9a7c949 already in progress: creating tablet
W20260807 11:08:43.756873 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 69df15a9057c4a9597b6239a33920950 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69df15a9057c4a9597b6239a33920950 already in progress: creating tablet
I20260807 11:08:43.757555 23046 master_service.cc:946] ReplaceTablet: received request to replace tablet 612c4e9a831f41ddb3304ad0f9a7c949 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:43.765530 24261 tablet_bootstrap.cc:654] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:43.767642 23046 master_service.cc:946] ReplaceTablet: received request to replace tablet 69df15a9057c4a9597b6239a33920950 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:43.773036 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:43.779203 24261 log.cc:824] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Log is configured to *not* fsync() on all Append() calls
W20260807 11:08:43.786664 23030 catalog_manager.cc:4808] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 612c4e9a831f41ddb3304ad0f9a7c949 because the tablet was not found. No further retry: Not found: Tablet not found: 612c4e9a831f41ddb3304ad0f9a7c949
I20260807 11:08:43.792800 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_ae9352e0450a4060933195affdc6e2d6" } new_table_name: "default.Table_80a5760372b14aed82c522d69f677324" modify_external_catalogs: true
I20260807 11:08:43.807322 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a6f456ed13f54602ae1020b7ffb1c746" } new_table_name: "default.Table_316461991c264cbd81b1947ff9cdb06a" modify_external_catalogs: true
I20260807 11:08:43.824761 24262 tablet_bootstrap.cc:492] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:43.825392 24262 ts_tablet_manager.cc:1397] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.129s user 0.017s sys 0.000s
I20260807 11:08:43.827561 24261 tablet_bootstrap.cc:492] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:43.828058 24261 ts_tablet_manager.cc:1397] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.084s user 0.015s sys 0.000s
W20260807 11:08:43.839529 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 327d0c0dd3fa46c296c21d7cc79e368c consensus state has no leader
I20260807 11:08:43.839421 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 327d0c0dd3fa46c296c21d7cc79e368c (DEFAULT_TABLE table=default.Table_ae9352e0450a4060933195affdc6e2d6 [id=be75698d1fc146089a8005ded7efe6de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.840471 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 327d0c0dd3fa46c296c21d7cc79e368c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.843602 24021 tablet_service.cc:1467] Processing CreateTablet for tablet 327d0c0dd3fa46c296c21d7cc79e368c (DEFAULT_TABLE table=default.Table_ae9352e0450a4060933195affdc6e2d6 [id=be75698d1fc146089a8005ded7efe6de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.844434 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 327d0c0dd3fa46c296c21d7cc79e368c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.847715 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 327d0c0dd3fa46c296c21d7cc79e368c (DEFAULT_TABLE table=default.Table_ae9352e0450a4060933195affdc6e2d6 [id=be75698d1fc146089a8005ded7efe6de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.848901 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 327d0c0dd3fa46c296c21d7cc79e368c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:43.857692 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5505cb8da7ce474ea3a8dff33ea0af56 consensus state has no leader
I20260807 11:08:43.834103 24266 tablet_bootstrap.cc:492] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:43.882839 23041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_48a68415bdce41348c38732cfe17762d" } modify_external_catalogs: true
I20260807 11:08:43.883497 23041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_48a68415bdce41348c38732cfe17762d" } modify_external_catalogs: true
I20260807 11:08:43.890636 24266 tablet_bootstrap.cc:654] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:43.897775 24261 raft_consensus.cc:348] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:43.898880 24261 raft_consensus.cc:374] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:43.899241 24261 raft_consensus.cc:729] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:43.900410 24261 consensus_queue.cc:260] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:43.920809 24266 log.cc:824] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Log is configured to *not* fsync() on all Append() calls
I20260807 11:08:43.940042 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 0d34369003a846c6aa0b6ac22177f6b2 (DEFAULT_TABLE table=default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.940846 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 0d34369003a846c6aa0b6ac22177f6b2 (DEFAULT_TABLE table=default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.941324 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d34369003a846c6aa0b6ac22177f6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.942078 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d34369003a846c6aa0b6ac22177f6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.957201 23041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 46dcd20b44b2493b84ef115a546ef215
I20260807 11:08:43.960021 24261 ts_tablet_manager.cc:1428] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.132s user 0.038s sys 0.025s
I20260807 11:08:43.960433 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:43.962410 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:43.962793 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 46dcd20b44b2493b84ef115a546ef215 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcd20b44b2493b84ef115a546ef215 already in progress: creating tablet
I20260807 11:08:43.967643 24261 tablet_bootstrap.cc:492] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:43.968051 23696 heartbeater.cc:503] Master 127.22.115.254:40237 was elected leader, sending a full tablet report...
I20260807 11:08:43.976294 24021 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:43.981707 24261 tablet_bootstrap.cc:654] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:43.983925 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 46dcd20b44b2493b84ef115a546ef215 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcd20b44b2493b84ef115a546ef215 already in progress: creating tablet
I20260807 11:08:43.986533 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 93a693730d9540049fda960d351425e3 (DEFAULT_TABLE table=default.Table_83665ed20c9240c790c6ebe6ca706e6f [id=7454612b977146668cdbbaab7a5baee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.987936 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93a693730d9540049fda960d351425e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:43.993284 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 46dcd20b44b2493b84ef115a546ef215 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcd20b44b2493b84ef115a546ef215 already in progress: creating tablet
W20260807 11:08:43.994755 23701 tablet.cc:2369] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 11:08:43.996935 24021 tablet_service.cc:1467] Processing CreateTablet for tablet 0d34369003a846c6aa0b6ac22177f6b2 (DEFAULT_TABLE table=default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:43.998006 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d34369003a846c6aa0b6ac22177f6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:43.998513 24261 tablet_bootstrap.cc:492] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:44.000583 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 93a693730d9540049fda960d351425e3 (DEFAULT_TABLE table=default.Table_83665ed20c9240c790c6ebe6ca706e6f [id=7454612b977146668cdbbaab7a5baee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.001608 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93a693730d9540049fda960d351425e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.010721 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 24d81c13089a44af8eb29400e0de721c (DEFAULT_TABLE table=default.Table_1c6713370c9f41ba91509a0773101822 [id=f78c550f25a449ef9d47d66dd609e908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.011896 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d81c13089a44af8eb29400e0de721c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.015481 24261 ts_tablet_manager.cc:1397] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.011s
I20260807 11:08:44.018338 24271 raft_consensus.cc:482] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:44.018874 24271 raft_consensus.cc:504] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:44.019351 24232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:08:44.020319 24232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:08:44.021173 24232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 11:08:44.021894 24271 leader_election.cc:288] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:44.022416 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_46bd7768ab0448748bbf44fa1eb1d07e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:44.023066 23041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_316461991c264cbd81b1947ff9cdb06a" } modify_external_catalogs: true
I20260807 11:08:44.023638 23041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_316461991c264cbd81b1947ff9cdb06a" } modify_external_catalogs: true
I20260807 11:08:44.007687 23048 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 327d0c0dd3fa46c296c21d7cc79e368c (table default.Table_80a5760372b14aed82c522d69f677324 [id=be75698d1fc146089a8005ded7efe6de]). Expected version 1 got 0
I20260807 11:08:44.018000 24261 raft_consensus.cc:348] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:44.024075 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46bd7768ab0448748bbf44fa1eb1d07e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.024371 24261 raft_consensus.cc:374] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.024641 24261 raft_consensus.cc:729] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.024883 23045 master_service.cc:946] ReplaceTablet: received request to replace tablet 5505cb8da7ce474ea3a8dff33ea0af56 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:44.025518 23040 master_service.cc:946] ReplaceTablet: received request to replace tablet 69df15a9057c4a9597b6239a33920950 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:44.025256 24261 consensus_queue.cc:260] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.026369 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_cd122291b5e84cb89e88551f4151e23e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:44.027535 24261 ts_tablet_manager.cc:1428] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.012s user 0.004s sys 0.002s
I20260807 11:08:44.027403 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6c398ac5d7fe46888acd6dfa36ddfbbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:44.028008 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd122291b5e84cb89e88551f4151e23e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.028359 24261 tablet_bootstrap.cc:492] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:44.028970 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c398ac5d7fe46888acd6dfa36ddfbbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.032335 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_8c27f75141c74191bcb6685cfdf62927"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:44.033823 24261 tablet_bootstrap.cc:654] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:44.033962 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c27f75141c74191bcb6685cfdf62927 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.036477 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 93a693730d9540049fda960d351425e3 (DEFAULT_TABLE table=default.Table_83665ed20c9240c790c6ebe6ca706e6f [id=7454612b977146668cdbbaab7a5baee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.037633 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93a693730d9540049fda960d351425e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.037748 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 24d81c13089a44af8eb29400e0de721c (DEFAULT_TABLE table=default.Table_1c6713370c9f41ba91509a0773101822 [id=f78c550f25a449ef9d47d66dd609e908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.038801 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d81c13089a44af8eb29400e0de721c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.052660 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 24d81c13089a44af8eb29400e0de721c (DEFAULT_TABLE table=default.Table_1c6713370c9f41ba91509a0773101822 [id=f78c550f25a449ef9d47d66dd609e908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.054024 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d81c13089a44af8eb29400e0de721c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.063500 23048 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 5505cb8da7ce474ea3a8dff33ea0af56 (table default.Table_316461991c264cbd81b1947ff9cdb06a [id=022b0768d03845f89e05a4206d49ff01]). Expected version 1 got 0
I20260807 11:08:44.064864 24261 tablet_bootstrap.cc:492] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:44.065376 24261 ts_tablet_manager.cc:1397] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.008s
I20260807 11:08:44.065745 24127 heartbeater.cc:503] Master 127.22.115.254:40237 was elected leader, sending a full tablet report...
I20260807 11:08:44.069303 24261 raft_consensus.cc:348] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.070427 24261 raft_consensus.cc:374] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.070729 24261 raft_consensus.cc:729] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.071075 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_1c6713370c9f41ba91509a0773101822" } new_table_name: "default.Table_79a7000df23c40f4b9b2ca741893f1f4" modify_external_catalogs: true
I20260807 11:08:44.071470 24261 consensus_queue.cc:260] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.071784 23036 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_80a5760372b14aed82c522d69f677324" } new_table_name: "default.Table_49f9a17fe8784347a0d0905f8b12e0c8" modify_external_catalogs: true
I20260807 11:08:44.074661 24261 ts_tablet_manager.cc:1428] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260807 11:08:44.075730 24261 tablet_bootstrap.cc:492] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:44.084046 24261 tablet_bootstrap.cc:654] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.098268 24261 tablet_bootstrap.cc:492] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:44.098754 24261 ts_tablet_manager.cc:1397] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.014s
I20260807 11:08:44.102057 24261 raft_consensus.cc:348] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.104573 24261 raft_consensus.cc:374] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.104913 24261 raft_consensus.cc:729] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.105615 24261 consensus_queue.cc:260] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.106321 24262 raft_consensus.cc:348] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.108503 24261 ts_tablet_manager.cc:1428] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 11:08:44.108609 24262 raft_consensus.cc:374] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.109607 24261 tablet_bootstrap.cc:492] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:44.108966 24262 raft_consensus.cc:729] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.113870 24262 consensus_queue.cc:260] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.117764 24261 tablet_bootstrap.cc:654] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.131397 23041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 5505cb8da7ce474ea3a8dff33ea0af56
I20260807 11:08:44.134815 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:44.138353 24266 tablet_bootstrap.cc:492] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
W20260807 11:08:44.138985 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 5505cb8da7ce474ea3a8dff33ea0af56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5505cb8da7ce474ea3a8dff33ea0af56 already in progress: creating tablet
I20260807 11:08:44.139098 24266 ts_tablet_manager.cc:1397] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.306s user 0.010s sys 0.011s
I20260807 11:08:44.151983 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:44.153891 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 5505cb8da7ce474ea3a8dff33ea0af56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5505cb8da7ce474ea3a8dff33ea0af56 already in progress: creating tablet
W20260807 11:08:44.158793 24111 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd200 after lost signal to thread 23926
W20260807 11:08:44.170689 23036 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 327d0c0dd3fa46c296c21d7cc79e368c consensus state has no leader
I20260807 11:08:44.221730 23583 tablet_service.cc:1514] Processing DeleteTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:44.236176 24232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:08:44.236631 24232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:08:44.236981 24232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:08:44.237320 24232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 11:08:44.242424 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 5505cb8da7ce474ea3a8dff33ea0af56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5505cb8da7ce474ea3a8dff33ea0af56 already in progress: creating tablet
I20260807 11:08:44.243130 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:44.244273 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:44.264009 24250 tablet_replica.cc:330] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:44.239931 23583 tablet_service.cc:1514] Processing DeleteTablet for tablet 69df15a9057c4a9597b6239a33920950 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:44.262662 23041 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 327d0c0dd3fa46c296c21d7cc79e368c (table default.Table_49f9a17fe8784347a0d0905f8b12e0c8 [id=be75698d1fc146089a8005ded7efe6de]). Expected version 2 got 0
I20260807 11:08:44.275837 24250 raft_consensus.cc:2229] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:44.277333 24250 raft_consensus.cc:2258] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:44.279249 23046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6c398ac5d7fe46888acd6dfa36ddfbbf" } modify_external_catalogs: true
I20260807 11:08:44.280157 23046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6c398ac5d7fe46888acd6dfa36ddfbbf" } modify_external_catalogs: true
I20260807 11:08:44.285041 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69df15a9057c4a9597b6239a33920950" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:44.286247 24261 tablet_bootstrap.cc:492] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:44.287043 24261 ts_tablet_manager.cc:1397] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.178s user 0.016s sys 0.008s
W20260807 11:08:44.292191 23507 leader_election.cc:341] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:44.293799 23808 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:44.294342 24262 ts_tablet_manager.cc:1428] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.469s user 0.064s sys 0.012s
I20260807 11:08:44.297549 24261 raft_consensus.cc:348] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:44.298743 24261 raft_consensus.cc:374] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.302191 24250 ts_tablet_manager.cc:1905] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:44.299993 24261 raft_consensus.cc:729] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.303926 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 69df15a9057c4a9597b6239a33920950 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:44.305447 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:44.306996 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 69df15a9057c4a9597b6239a33920950 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69df15a9057c4a9597b6239a33920950 already in progress: creating tablet
W20260807 11:08:44.308382 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 46dcd20b44b2493b84ef115a546ef215 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcd20b44b2493b84ef115a546ef215 already in progress: creating tablet
I20260807 11:08:44.311530 24247 tablet_replica.cc:330] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:44.312889 24247 raft_consensus.cc:2229] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:44.313733 24247 raft_consensus.cc:2258] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:44.315927 24261 consensus_queue.cc:260] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:44.317698 24247 ts_tablet_manager.cc:1905] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:44.322022 24021 tablet_service.cc:1514] Processing DeleteTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:44.324242 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:44.327397 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 5505cb8da7ce474ea3a8dff33ea0af56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5505cb8da7ce474ea3a8dff33ea0af56 already in progress: creating tablet
W20260807 11:08:44.328531 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 612c4e9a831f41ddb3304ad0f9a7c949 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 612c4e9a831f41ddb3304ad0f9a7c949 already in progress: creating tablet
I20260807 11:08:44.339560 23048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_49f9a17fe8784347a0d0905f8b12e0c8" } modify_external_catalogs: true
I20260807 11:08:44.340492 23048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_49f9a17fe8784347a0d0905f8b12e0c8" } modify_external_catalogs: true
I20260807 11:08:44.341202 24261 ts_tablet_manager.cc:1428] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.054s user 0.011s sys 0.000s
I20260807 11:08:44.342736 24261 tablet_bootstrap.cc:492] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:44.370546 24250 ts_tablet_manager.cc:1918] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:44.371071 24250 log.cc:1196] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/612c4e9a831f41ddb3304ad0f9a7c949
I20260807 11:08:44.372938 24262 tablet_bootstrap.cc:492] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:44.381649 24232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:40237,127.22.115.253:40309,127.22.115.252:40555
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:40555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.115.252
--webserver_port=46049
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:08:44.383548 24232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:08:44.386086 24232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:08:44.391512 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24d81c13089a44af8eb29400e0de721c consensus state has no leader
I20260807 11:08:44.413273 24250 ts_tablet_manager.cc:1939] T 612c4e9a831f41ddb3304ad0f9a7c949 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:44.423934 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 612c4e9a831f41ddb3304ad0f9a7c949 (table default.Table_1464bf48282c42ae9b47093453f7db96 [id=4c7601a951374a9aa81371462d6bc20f]) successfully deleted
I20260807 11:08:44.425639 24250 tablet_replica.cc:330] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:44.429816 24250 raft_consensus.cc:2229] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:44.430611 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69df15a9057c4a9597b6239a33920950" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:44.431228 24250 raft_consensus.cc:2258] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260807 11:08:44.436064 23510 leader_election.cc:341] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:44.436570 23510 leader_election.cc:302] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:44.438477 24250 ts_tablet_manager.cc:1905] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:44.438650 24271 raft_consensus.cc:2726] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:44.440668 23042 master_service.cc:946] ReplaceTablet: received request to replace tablet 46dcd20b44b2493b84ef115a546ef215 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:44.447328 23037 master_service.cc:946] ReplaceTablet: received request to replace tablet 327d0c0dd3fa46c296c21d7cc79e368c from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:44.450912 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_46bd7768ab0448748bbf44fa1eb1d07e" } new_table_name: "default.Table_459cf05b003a447dae6a8e1b8f3c04c3" modify_external_catalogs: true
I20260807 11:08:44.454454 24262 tablet_bootstrap.cc:654] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.453655 24266 raft_consensus.cc:348] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.454766 24266 raft_consensus.cc:374] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.455150 24266 raft_consensus.cc:729] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.456257 24266 consensus_queue.cc:260] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.471707 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_a7ad854935ce4319920d4f9f81ee4b6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:44.471985 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_79d4708c11e142898ac8f110ae900110"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:44.473779 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7ad854935ce4319920d4f9f81ee4b6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.479450 24266 ts_tablet_manager.cc:1428] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.340s user 0.029s sys 0.035s
W20260807 11:08:44.479592 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79d4708c11e142898ac8f110ae900110 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.479923 24261 tablet_bootstrap.cc:654] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.480849 24266 tablet_bootstrap.cc:492] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:08:44.490516 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 834f5f852f8c42da8d632b6f2e87e4a4 has no consensus state
W20260807 11:08:44.508102 24132 tablet.cc:2369] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 11:08:44.510079 24247 ts_tablet_manager.cc:1918] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:44.510778 24247 log.cc:1196] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/612c4e9a831f41ddb3304ad0f9a7c949
I20260807 11:08:44.511515 24266 tablet_bootstrap.cc:654] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.518473 23046 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 53c68e3b3b2e4782af45d4b30e9b7f6e
I20260807 11:08:44.527220 24022 tablet_service.cc:1514] Processing DeleteTablet for tablet 69df15a9057c4a9597b6239a33920950 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:44.531428 24247 ts_tablet_manager.cc:1939] T 612c4e9a831f41ddb3304ad0f9a7c949 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:44.532925 24252 tablet_replica.cc:330] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:44.533897 24252 raft_consensus.cc:2229] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:44.534484 24252 raft_consensus.cc:2258] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:44.535156 24266 tablet_bootstrap.cc:492] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:44.536254 24266 ts_tablet_manager.cc:1397] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.012s
I20260807 11:08:44.541952 24252 ts_tablet_manager.cc:1905] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:44.544639 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 612c4e9a831f41ddb3304ad0f9a7c949 (table default.Table_1464bf48282c42ae9b47093453f7db96 [id=4c7601a951374a9aa81371462d6bc20f]) successfully deleted
I20260807 11:08:44.548756 24262 tablet_bootstrap.cc:492] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:44.547262 24266 raft_consensus.cc:348] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.550482 24262 ts_tablet_manager.cc:1397] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.178s user 0.009s sys 0.011s
I20260807 11:08:44.554541 24262 raft_consensus.cc:348] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.555665 24262 raft_consensus.cc:374] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.550529 24266 raft_consensus.cc:374] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.556146 24262 raft_consensus.cc:729] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.556804 24266 raft_consensus.cc:729] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.561983 24250 ts_tablet_manager.cc:1918] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:44.561393 24266 consensus_queue.cc:260] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.562983 24262 consensus_queue.cc:260] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.567028 24262 ts_tablet_manager.cc:1428] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.016s user 0.003s sys 0.010s
I20260807 11:08:44.568423 24250 log.cc:1196] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/46dcd20b44b2493b84ef115a546ef215
I20260807 11:08:44.569296 24250 ts_tablet_manager.cc:1939] T 46dcd20b44b2493b84ef115a546ef215 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
W20260807 11:08:44.571362 23921 tablet.cc:2369] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 11:08:44.571357 24305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:44.568193 24266 ts_tablet_manager.cc:1428] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.031s user 0.004s sys 0.005s
I20260807 11:08:44.573043 24266 tablet_bootstrap.cc:492] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:44.575721 24262 tablet_bootstrap.cc:492] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:44.583050 24250 tablet_replica.cc:330] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:44.584241 24250 raft_consensus.cc:2229] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:44.585031 24250 raft_consensus.cc:2258] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:44.588071 24250 ts_tablet_manager.cc:1905] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:44.599135 24271 raft_consensus.cc:482] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:44.599613 24271 raft_consensus.cc:504] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.604069 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d4571045043eb8ec87b5f31871a09" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:44.604828 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d4571045043eb8ec87b5f31871a09" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:44.605212 23846 raft_consensus.cc:2454] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:44.605931 24058 raft_consensus.cc:2454] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:44.609290 24262 tablet_bootstrap.cc:654] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.626132 24266 tablet_bootstrap.cc:654] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.629046 24262 tablet_bootstrap.cc:492] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:44.629631 24262 ts_tablet_manager.cc:1397] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.013s
I20260807 11:08:44.636546 24252 ts_tablet_manager.cc:1918] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:44.637056 23510 leader_election.cc:302] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:08:44.637480 24252 log.cc:1196] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/69df15a9057c4a9597b6239a33920950
I20260807 11:08:44.640249 24252 ts_tablet_manager.cc:1939] T 69df15a9057c4a9597b6239a33920950 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:44.646170 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 46dcd20b44b2493b84ef115a546ef215 (table default.Table_48a68415bdce41348c38732cfe17762d [id=1d96f575ea9747ca9ffcffe946c858ac]) successfully deleted
I20260807 11:08:44.646449 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6af69aaf5147422597a579fe9a2ccd87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:44.647410 23046 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_8c27f75141c74191bcb6685cfdf62927" } new_table_name: "default.Table_2b93d1fbf5c24e84a94a18ad6d284e10" modify_external_catalogs: true
W20260807 11:08:44.649590 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6af69aaf5147422597a579fe9a2ccd87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.645958 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_5625af41495d4859b5a3521bf740e72a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:44.654830 23029 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 834f5f852f8c42da8d632b6f2e87e4a4 (table default.Table_459cf05b003a447dae6a8e1b8f3c04c3 [id=6626506972f940ecb9e11aa4c886faa0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 834f5f852f8c42da8d632b6f2e87e4a4 has no consensus state
I20260807 11:08:44.656853 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 69df15a9057c4a9597b6239a33920950 (table default.Table_4ea089dc2f224c50b572756022203a08 [id=3093745fb4e34d2b9ecc5b93ac6deb97]) successfully deleted
W20260807 11:08:44.658768 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5625af41495d4859b5a3521bf740e72a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.635597 24262 raft_consensus.cc:348] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.670720 24266 tablet_bootstrap.cc:492] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:44.676697 24262 raft_consensus.cc:374] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.676903 24266 ts_tablet_manager.cc:1397] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.020s
I20260807 11:08:44.684836 24266 raft_consensus.cc:348] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.677977 24262 raft_consensus.cc:729] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.685885 24266 raft_consensus.cc:374] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.686300 24266 raft_consensus.cc:729] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.693619 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 2894fd38844b446f978022b8a1e5b2df (DEFAULT_TABLE table=default.Table_cd122291b5e84cb89e88551f4151e23e [id=ff1332012e264831adffc1c10a065f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.686770 24262 consensus_queue.cc:260] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.695209 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2894fd38844b446f978022b8a1e5b2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.695398 24266 consensus_queue.cc:260] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.699492 24266 ts_tablet_manager.cc:1428] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.022s user 0.006s sys 0.006s
I20260807 11:08:44.701115 24266 tablet_bootstrap.cc:492] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:44.707252 24262 ts_tablet_manager.cc:1428] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.077s user 0.000s sys 0.014s
I20260807 11:08:44.714910 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_cd122291b5e84cb89e88551f4151e23e" } new_table_name: "default.Table_00fe20984bdc4199b3741171807f1d77" modify_external_catalogs: true
I20260807 11:08:44.716977 24262 tablet_bootstrap.cc:492] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:44.735534 23045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_459cf05b003a447dae6a8e1b8f3c04c3" } modify_external_catalogs: true
I20260807 11:08:44.736497 23045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_459cf05b003a447dae6a8e1b8f3c04c3" } modify_external_catalogs: true
I20260807 11:08:44.602708 24271 leader_election.cc:288] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:44.748457 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 69df15a9057c4a9597b6239a33920950 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:44.748208 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 2894fd38844b446f978022b8a1e5b2df (DEFAULT_TABLE table=default.Table_cd122291b5e84cb89e88551f4151e23e [id=ff1332012e264831adffc1c10a065f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.749917 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2894fd38844b446f978022b8a1e5b2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.751351 24247 tablet_replica.cc:330] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:44.751873 24311 raft_consensus.cc:2781] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:44.752743 24311 raft_consensus.cc:482] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:44.753350 24311 raft_consensus.cc:3037] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:44.755146 24247 raft_consensus.cc:2229] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:44.755574 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 2894fd38844b446f978022b8a1e5b2df (DEFAULT_TABLE table=default.Table_cd122291b5e84cb89e88551f4151e23e [id=ff1332012e264831adffc1c10a065f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:44.757331 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2894fd38844b446f978022b8a1e5b2df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:44.760325 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:44.760419 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:44.762953 24266 tablet_bootstrap.cc:654] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.771886 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 612c4e9a831f41ddb3304ad0f9a7c949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:44.772938 24252 tablet_replica.cc:330] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:44.774355 24252 raft_consensus.cc:2229] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:44.775215 24252 raft_consensus.cc:2258] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:44.743085 24271 raft_consensus.cc:482] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:08:44.782542 23046 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd720024e90344a7a419a5293d742b22 has no consensus state
I20260807 11:08:44.786218 24252 ts_tablet_manager.cc:1905] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:44.782549 24271 raft_consensus.cc:504] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:44.793646 24247 raft_consensus.cc:2258] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:44.795341 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5505cb8da7ce474ea3a8dff33ea0af56" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:44.796772 24247 ts_tablet_manager.cc:1905] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:44.797225 23507 leader_election.cc:341] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:44.797986 24271 leader_election.cc:288] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:44.786670 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 149711us
I20260807 11:08:44.801890 24266 tablet_bootstrap.cc:492] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:44.802521 24266 ts_tablet_manager.cc:1397] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.102s user 0.006s sys 0.015s
I20260807 11:08:44.803057 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5505cb8da7ce474ea3a8dff33ea0af56" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:44.805277 23510 leader_election.cc:341] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:44.806025 23510 leader_election.cc:302] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:44.811968 24266 raft_consensus.cc:348] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.813141 24266 raft_consensus.cc:374] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.813534 24266 raft_consensus.cc:729] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.814496 24266 consensus_queue.cc:260] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.822136 24266 ts_tablet_manager.cc:1428] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.019s user 0.012s sys 0.001s
I20260807 11:08:44.823386 24266 tablet_bootstrap.cc:492] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:44.815534 24261 tablet_bootstrap.cc:492] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:44.839607 24022 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:44.848165 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:44.857728 24261 ts_tablet_manager.cc:1397] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.515s user 0.004s sys 0.021s
I20260807 11:08:44.863729 24266 tablet_bootstrap.cc:654] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.863356 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_3c7ba7b38d804dce82d12b1709901e65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:44.865837 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c7ba7b38d804dce82d12b1709901e65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:44.858691 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 53418.1us
I20260807 11:08:44.859540 24271 raft_consensus.cc:2726] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:44.875659 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_de2fda64fc2849309013654ccdb0c188"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:44.884472 24299 raft_consensus.cc:482] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:44.885193 24299 raft_consensus.cc:504] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.822296 24311 raft_consensus.cc:504] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:44.895746 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de2fda64fc2849309013654ccdb0c188 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.919498 23043 master_service.cc:946] ReplaceTablet: received request to replace tablet 0d34369003a846c6aa0b6ac22177f6b2 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:44.882232 24261 raft_consensus.cc:348] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.926965 24261 raft_consensus.cc:374] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:44.928025 24261 raft_consensus.cc:729] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:44.929378 24262 tablet_bootstrap.cc:654] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:44.929288 24261 consensus_queue.cc:260] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:44.933808 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d4571045043eb8ec87b5f31871a09" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:44.934744 23846 raft_consensus.cc:3037] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:44.938253 24311 leader_election.cc:288] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:44.941565 23048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 327d0c0dd3fa46c296c21d7cc79e368c
I20260807 11:08:44.943600 23045 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 834f5f852f8c42da8d632b6f2e87e4a4
I20260807 11:08:44.948493 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 327d0c0dd3fa46c296c21d7cc79e368c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:44.952497 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet 327d0c0dd3fa46c296c21d7cc79e368c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:44.954092 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2894fd38844b446f978022b8a1e5b2df consensus state has no leader
I20260807 11:08:44.954329 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3d4571045043eb8ec87b5f31871a09" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:44.955400 24058 raft_consensus.cc:3037] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:44.957677 24022 tablet_service.cc:1514] Processing DeleteTablet for tablet 327d0c0dd3fa46c296c21d7cc79e368c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:44.958664 24247 ts_tablet_manager.cc:1918] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:44.968743 24299 leader_election.cc:288] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:44.965840 24247 log.cc:1196] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/69df15a9057c4a9597b6239a33920950
I20260807 11:08:44.974481 24247 ts_tablet_manager.cc:1939] T 69df15a9057c4a9597b6239a33920950 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:44.984800 23846 raft_consensus.cc:2454] T 1f3d4571045043eb8ec87b5f31871a09 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:44.985898 23507 leader_election.cc:302] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:44.991736 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6ef264aeb7184ea199291802ec73a43f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:44.993396 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ef264aeb7184ea199291802ec73a43f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:44.998421 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_00fe20984bdc4199b3741171807f1d77" } new_table_name: "default.Table_97a8a61ce0154bb2bba0517931520b67" modify_external_catalogs: true
W20260807 11:08:45.053820 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2894fd38844b446f978022b8a1e5b2df consensus state has no leader
I20260807 11:08:45.058269 24262 tablet_bootstrap.cc:492] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:45.058873 24262 ts_tablet_manager.cc:1397] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.342s user 0.019s sys 0.003s
I20260807 11:08:45.062779 24262 raft_consensus.cc:348] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.064160 24262 raft_consensus.cc:374] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.064584 24262 raft_consensus.cc:729] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.065239 23580 tablet_service.cc:1467] Processing CreateTablet for tablet bd720024e90344a7a419a5293d742b22 (DEFAULT_TABLE table=default.Table_2b93d1fbf5c24e84a94a18ad6d284e10 [id=5319693d27304aa3bac2365055974a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.065908 23573 tablet_service.cc:1467] Processing CreateTablet for tablet b677f3eac3f14f848a621e5b21e2393e (DEFAULT_TABLE table=default.Table_a7ad854935ce4319920d4f9f81ee4b6f [id=592d4df712864a53b5b7595a18dca4c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.065624 24262 consensus_queue.cc:260] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.066557 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd720024e90344a7a419a5293d742b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.067016 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 42a046eb45bf4d619008ead6f6580713 (DEFAULT_TABLE table=default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.071250 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b677f3eac3f14f848a621e5b21e2393e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.075753 24262 ts_tablet_manager.cc:1428] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260807 11:08:45.077414 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_a70046e0e22b47878d24ab3c264af9cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:45.081248 24262 tablet_bootstrap.cc:492] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:45.081028 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a70046e0e22b47878d24ab3c264af9cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:45.090430 24266 tablet_bootstrap.cc:492] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:45.091153 24266 ts_tablet_manager.cc:1397] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.268s user 0.050s sys 0.055s
I20260807 11:08:45.100678 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 42a046eb45bf4d619008ead6f6580713 (DEFAULT_TABLE table=default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.100951 24017 tablet_service.cc:1467] Processing CreateTablet for tablet bd720024e90344a7a419a5293d742b22 (DEFAULT_TABLE table=default.Table_2b93d1fbf5c24e84a94a18ad6d284e10 [id=5319693d27304aa3bac2365055974a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.102160 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a046eb45bf4d619008ead6f6580713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.102823 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd720024e90344a7a419a5293d742b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.112138 24021 tablet_service.cc:1467] Processing CreateTablet for tablet b677f3eac3f14f848a621e5b21e2393e (DEFAULT_TABLE table=default.Table_a7ad854935ce4319920d4f9f81ee4b6f [id=592d4df712864a53b5b7595a18dca4c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.113569 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b677f3eac3f14f848a621e5b21e2393e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.116616 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 69df15a9057c4a9597b6239a33920950 (table default.Table_4ea089dc2f224c50b572756022203a08 [id=3093745fb4e34d2b9ecc5b93ac6deb97]) successfully deleted
W20260807 11:08:45.117451 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 327d0c0dd3fa46c296c21d7cc79e368c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 327d0c0dd3fa46c296c21d7cc79e368c already in progress: creating tablet
I20260807 11:08:45.117955 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 42a046eb45bf4d619008ead6f6580713 (DEFAULT_TABLE table=default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.118208 23818 tablet_service.cc:1467] Processing CreateTablet for tablet bd720024e90344a7a419a5293d742b22 (DEFAULT_TABLE table=default.Table_2b93d1fbf5c24e84a94a18ad6d284e10 [id=5319693d27304aa3bac2365055974a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.119041 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a046eb45bf4d619008ead6f6580713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.119815 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd720024e90344a7a419a5293d742b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.098021 24266 raft_consensus.cc:348] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:45.120608 24266 raft_consensus.cc:374] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.120898 24266 raft_consensus.cc:729] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.121562 24266 consensus_queue.cc:260] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:45.127509 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a046eb45bf4d619008ead6f6580713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.128118 23809 tablet_service.cc:1467] Processing CreateTablet for tablet b677f3eac3f14f848a621e5b21e2393e (DEFAULT_TABLE table=default.Table_a7ad854935ce4319920d4f9f81ee4b6f [id=592d4df712864a53b5b7595a18dca4c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.129128 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b677f3eac3f14f848a621e5b21e2393e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:45.139089 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 153300us
I20260807 11:08:45.140045 24262 tablet_bootstrap.cc:654] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.140200 24312 raft_consensus.cc:2781] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:45.140726 24312 raft_consensus.cc:686] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:45.141155 24261 ts_tablet_manager.cc:1428] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.281s user 0.000s sys 0.010s
I20260807 11:08:45.156662 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a7ad854935ce4319920d4f9f81ee4b6f" } modify_external_catalogs: true
I20260807 11:08:45.157655 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a7ad854935ce4319920d4f9f81ee4b6f" } modify_external_catalogs: true
I20260807 11:08:45.159973 24266 ts_tablet_manager.cc:1428] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.065s user 0.004s sys 0.004s
I20260807 11:08:45.142194 24312 consensus_queue.cc:237] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.166535 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_3c7ba7b38d804dce82d12b1709901e65" } modify_external_catalogs: true
I20260807 11:08:45.167375 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_3c7ba7b38d804dce82d12b1709901e65" } modify_external_catalogs: true
I20260807 11:08:45.168000 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_de2fda64fc2849309013654ccdb0c188" } new_table_name: "default.Table_a7658071bcf140b7a98557dffc8a9289" modify_external_catalogs: true
I20260807 11:08:45.170626 23043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 0d34369003a846c6aa0b6ac22177f6b2
I20260807 11:08:45.176144 23813 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d34369003a846c6aa0b6ac22177f6b2 with delete_type TABLET_DATA_DELETED (replaced by tablet c2049735828546ac9a996d26f6119127) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:45.177973 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d34369003a846c6aa0b6ac22177f6b2 with delete_type TABLET_DATA_DELETED (replaced by tablet c2049735828546ac9a996d26f6119127) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:45.188716 23043 catalog_manager.cc:6565] ReplaceTablet: tablet 0d34369003a846c6aa0b6ac22177f6b2 deleted and replaced by tablet c2049735828546ac9a996d26f6119127
I20260807 11:08:45.202443 23808 tablet_service.cc:1514] Processing DeleteTablet for tablet 46dcd20b44b2493b84ef115a546ef215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:43 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:45.203791 24247 tablet_replica.cc:330] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:45.204891 24247 raft_consensus.cc:2229] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:45.205511 24247 raft_consensus.cc:2258] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:45.093168 24058 raft_consensus.cc:2454] T 1f3d4571045043eb8ec87b5f31871a09 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
W20260807 11:08:45.207355 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 0d34369003a846c6aa0b6ac22177f6b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d34369003a846c6aa0b6ac22177f6b2 already in progress: creating tablet
I20260807 11:08:45.208115 24247 ts_tablet_manager.cc:1905] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:45.216833 24262 tablet_bootstrap.cc:492] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:45.217420 24262 ts_tablet_manager.cc:1397] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.138s user 0.019s sys 0.007s
I20260807 11:08:45.230101 24262 raft_consensus.cc:348] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:45.230712 24262 raft_consensus.cc:374] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.235100 24262 raft_consensus.cc:729] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.236402 24262 consensus_queue.cc:260] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:45.242404 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet b677f3eac3f14f848a621e5b21e2393e
I20260807 11:08:45.255167 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet b677f3eac3f14f848a621e5b21e2393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:45.260152 24247 ts_tablet_manager.cc:1918] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:45.260807 24247 log.cc:1196] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/46dcd20b44b2493b84ef115a546ef215
I20260807 11:08:45.261626 24247 ts_tablet_manager.cc:1939] T 46dcd20b44b2493b84ef115a546ef215 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:45.264346 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 46dcd20b44b2493b84ef115a546ef215 (table default.Table_48a68415bdce41348c38732cfe17762d [id=1d96f575ea9747ca9ffcffe946c858ac]) successfully deleted
W20260807 11:08:45.266259 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet b677f3eac3f14f848a621e5b21e2393e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b677f3eac3f14f848a621e5b21e2393e already in progress: creating tablet
W20260807 11:08:45.268523 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd7256acb2114935922b69da9bc94209 has no consensus state
I20260807 11:08:45.271466 24262 ts_tablet_manager.cc:1428] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.054s user 0.003s sys 0.010s
I20260807 11:08:45.280648 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_a1a0d2467a984aa09f3450da197f285c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:45.284138 24262 tablet_bootstrap.cc:492] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:45.300518 24262 tablet_bootstrap.cc:654] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.298679 24271 raft_consensus.cc:482] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:45.317781 24018 tablet_service.cc:1514] Processing DeleteTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:45.318563 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d34369003a846c6aa0b6ac22177f6b2 with delete_type TABLET_DATA_DELETED (replaced by tablet c2049735828546ac9a996d26f6119127) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:45.320109 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet b677f3eac3f14f848a621e5b21e2393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:45.323480 24266 tablet_bootstrap.cc:492] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:45.333860 24262 tablet_bootstrap.cc:492] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:45.334542 24262 ts_tablet_manager.cc:1397] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.030s
I20260807 11:08:45.340299 24262 raft_consensus.cc:348] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.341745 24262 raft_consensus.cc:374] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.342348 24262 raft_consensus.cc:729] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.343031 24266 tablet_bootstrap.cc:654] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.343561 24262 consensus_queue.cc:260] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.351428 24262 ts_tablet_manager.cc:1428] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.016s user 0.006s sys 0.006s
I20260807 11:08:45.352823 24262 tablet_bootstrap.cc:492] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:45.368170 23951 leader_election.cc:341] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 46dcd20b44b2493b84ef115a546ef215
I20260807 11:08:45.373903 24262 tablet_bootstrap.cc:654] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.378777 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 5505cb8da7ce474ea3a8dff33ea0af56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:45.379098 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 114619us
I20260807 11:08:45.380369 24247 tablet_replica.cc:330] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:45.381065 24247 raft_consensus.cc:2229] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:45.381494 24247 raft_consensus.cc:2258] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:45.383889 24247 ts_tablet_manager.cc:1905] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:45.385409 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet b677f3eac3f14f848a621e5b21e2393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:45.390179 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6ef264aeb7184ea199291802ec73a43f" } new_table_name: "default.Table_446937ecf2464c339f98882c9fe91d9f" modify_external_catalogs: true
I20260807 11:08:45.393384 24261 tablet_bootstrap.cc:492] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:45.401168 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1a0d2467a984aa09f3450da197f285c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:45.364379 24271 raft_consensus.cc:504] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.408123 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_43b786b7fa8344208e879227a685c889"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:45.410601 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43b786b7fa8344208e879227a685c889 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:45.414383 24262 tablet_bootstrap.cc:492] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:45.414201 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "327d0c0dd3fa46c296c21d7cc79e368c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:45.414813 23846 raft_consensus.cc:2454] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:45.415015 24271 leader_election.cc:288] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:45.416435 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "327d0c0dd3fa46c296c21d7cc79e368c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:45.418586 23510 leader_election.cc:341] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:45.420297 23507 leader_election.cc:302] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:45.423230 24271 raft_consensus.cc:2781] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:45.423522 24271 raft_consensus.cc:482] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:45.423804 24271 raft_consensus.cc:3037] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:45.424901 24262 ts_tablet_manager.cc:1397] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.072s user 0.012s sys 0.026s
I20260807 11:08:45.427378 24262 raft_consensus.cc:348] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.428015 24262 raft_consensus.cc:374] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.428246 24262 raft_consensus.cc:729] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.428846 24262 consensus_queue.cc:260] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.436010 24262 ts_tablet_manager.cc:1428] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.011s user 0.003s sys 0.001s
I20260807 11:08:45.439870 24262 tablet_bootstrap.cc:492] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:45.448410 24262 tablet_bootstrap.cc:654] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.452605 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_54d50719e43e4c5e80fc27f01fcdb1d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:45.454488 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:45.458343 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 327d0c0dd3fa46c296c21d7cc79e368c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:44 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:45.458611 23043 master_service.cc:946] ReplaceTablet: received request to replace tablet 2894fd38844b446f978022b8a1e5b2df from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:45.459360 24262 tablet_bootstrap.cc:492] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:45.459776 24262 ts_tablet_manager.cc:1397] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.005s
I20260807 11:08:45.460837 23045 master_service.cc:946] ReplaceTablet: received request to replace tablet 2894fd38844b446f978022b8a1e5b2df from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:45.467446 24262 raft_consensus.cc:348] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.468142 24262 raft_consensus.cc:374] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.468385 24262 raft_consensus.cc:729] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.479319 24262 consensus_queue.cc:260] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.492785 24266 tablet_bootstrap.cc:492] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:45.497619 24261 tablet_bootstrap.cc:654] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.497959 24262 ts_tablet_manager.cc:1428] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.038s user 0.005s sys 0.001s
I20260807 11:08:45.502656 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_a3768b2e5463473f87677e7b739b90d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:45.504629 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3768b2e5463473f87677e7b739b90d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:45.509174 23036 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_83665ed20c9240c790c6ebe6ca706e6f" } modify_external_catalogs: true
I20260807 11:08:45.509689 24262 tablet_bootstrap.cc:492] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:45.509819 23036 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_83665ed20c9240c790c6ebe6ca706e6f" } modify_external_catalogs: true
I20260807 11:08:45.527374 23046 catalog_manager.cc:5495] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } }
I20260807 11:08:45.533800 24262 tablet_bootstrap.cc:654] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.536401 24250 ts_tablet_manager.cc:1918] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:45.537012 24250 log.cc:1196] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/69df15a9057c4a9597b6239a33920950
I20260807 11:08:45.538007 24250 ts_tablet_manager.cc:1939] T 69df15a9057c4a9597b6239a33920950 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:45.544176 24271 raft_consensus.cc:504] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.550128 24250 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 14) took 1324 ms. Trace:
I20260807 11:08:45.550720 24250 rpcz_store.cc:276] 0807 11:08:44.231098 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:44.235434 (+ 4336us) service_pool.cc:227] Handling call
0807 11:08:44.582771 (+347337us) ts_tablet_manager.cc:1145] Deleting tablet 69df15a9057c4a9597b6239a33920950
0807 11:08:44.582900 (+ 129us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:44.878413 (+295513us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:45.536063 (+657650us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:45.550022 (+ 13959us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":316870}
I20260807 11:08:45.556134 24250 tablet_replica.cc:330] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:45.557711 24250 raft_consensus.cc:2229] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:45.558312 24250 raft_consensus.cc:2258] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:45.560809 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "327d0c0dd3fa46c296c21d7cc79e368c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:45.562223 23846 raft_consensus.cc:3037] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:45.563676 24271 leader_election.cc:288] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:08:45.565852 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3430075bbedd48efbcd78cf6806623ac has no consensus state
I20260807 11:08:45.568022 24261 tablet_bootstrap.cc:492] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:45.568727 24261 ts_tablet_manager.cc:1397] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.188s user 0.009s sys 0.016s
I20260807 11:08:45.573184 24261 raft_consensus.cc:348] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.575541 24247 ts_tablet_manager.cc:1918] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:45.576148 24247 log.cc:1196] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/5505cb8da7ce474ea3a8dff33ea0af56
I20260807 11:08:45.576474 24250 ts_tablet_manager.cc:1905] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:45.577105 24247 ts_tablet_manager.cc:1939] T 5505cb8da7ce474ea3a8dff33ea0af56 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:45.577940 24262 tablet_bootstrap.cc:492] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:45.578373 24262 ts_tablet_manager.cc:1397] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.018s
I20260807 11:08:45.586961 24261 raft_consensus.cc:374] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.587258 24261 raft_consensus.cc:729] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.587517 24262 raft_consensus.cc:348] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:45.587817 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 75652us
I20260807 11:08:45.588158 24262 raft_consensus.cc:374] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.588409 24262 raft_consensus.cc:729] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.587894 24261 consensus_queue.cc:260] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.589208 24266 ts_tablet_manager.cc:1397] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.266s user 0.009s sys 0.023s
I20260807 11:08:45.588964 24262 consensus_queue.cc:260] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.590200 24261 ts_tablet_manager.cc:1428] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.021s user 0.005s sys 0.004s
W20260807 11:08:45.509845 23954 leader_election.cc:341] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 46dcd20b44b2493b84ef115a546ef215
I20260807 11:08:45.536401 24252 ts_tablet_manager.cc:1918] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:45.591131 23954 leader_election.cc:302] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:45.562800 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "327d0c0dd3fa46c296c21d7cc79e368c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:45.595388 23027 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 116774us
I20260807 11:08:45.601428 24262 ts_tablet_manager.cc:1428] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.023s user 0.006s sys 0.002s
I20260807 11:08:45.604650 24261 tablet_bootstrap.cc:492] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:45.604252 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 (DEFAULT_TABLE table=default.Table_5625af41495d4859b5a3521bf740e72a [id=2353f55fa7e149748a100664634353bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.602276 24262 tablet_bootstrap.cc:492] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:45.604851 23809 tablet_service.cc:1467] Processing CreateTablet for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (DEFAULT_TABLE table=default.Table_6af69aaf5147422597a579fe9a2ccd87 [id=97fa5c597042473aac2865ebebf63541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.605753 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cbe28c4d9bf47258c0f694e21e00b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.606732 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7d0d889f2541a9a5c3c45f1c39df06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.607965 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 (DEFAULT_TABLE table=default.Table_3c7ba7b38d804dce82d12b1709901e65 [id=741b1ed419a64bbe97e563dc541cb876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.609721 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c3fdae8df247e5b19a2bd8ffdeec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.620754 24261 tablet_bootstrap.cc:654] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.627435 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 (DEFAULT_TABLE table=default.Table_3c7ba7b38d804dce82d12b1709901e65 [id=741b1ed419a64bbe97e563dc541cb876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.629048 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c3fdae8df247e5b19a2bd8ffdeec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.632462 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 (DEFAULT_TABLE table=default.Table_5625af41495d4859b5a3521bf740e72a [id=2353f55fa7e149748a100664634353bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.633957 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cbe28c4d9bf47258c0f694e21e00b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.633965 24286 raft_consensus.cc:482] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:45.634701 24286 raft_consensus.cc:504] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.638796 23573 tablet_service.cc:1467] Processing CreateTablet for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (DEFAULT_TABLE table=default.Table_6af69aaf5147422597a579fe9a2ccd87 [id=97fa5c597042473aac2865ebebf63541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.640508 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7d0d889f2541a9a5c3c45f1c39df06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.643544 23846 raft_consensus.cc:2454] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:45.648214 23507 leader_election.cc:302] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:45.649590 24271 raft_consensus.cc:2781] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:45.650372 24271 raft_consensus.cc:686] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:45.651835 24271 consensus_queue.cc:237] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.658985 24286 leader_election.cc:288] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:45.667829 24262 tablet_bootstrap.cc:654] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.669059 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 69df15a9057c4a9597b6239a33920950 (table default.Table_4ea089dc2f224c50b572756022203a08 [id=3093745fb4e34d2b9ecc5b93ac6deb97]) successfully deleted
W20260807 11:08:45.680068 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 46dcd20b44b2493b84ef115a546ef215 because the tablet was not found. No further retry: Not found: Tablet not found: 46dcd20b44b2493b84ef115a546ef215
W20260807 11:08:45.680905 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 612c4e9a831f41ddb3304ad0f9a7c949 because the tablet was not found. No further retry: Not found: Tablet not found: 612c4e9a831f41ddb3304ad0f9a7c949
I20260807 11:08:45.684367 24261 tablet_bootstrap.cc:492] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:45.684754 24261 ts_tablet_manager.cc:1397] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.080s user 0.013s sys 0.005s
I20260807 11:08:45.686960 24261 raft_consensus.cc:348] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.687640 24261 raft_consensus.cc:374] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.687894 24261 raft_consensus.cc:729] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.688597 24261 consensus_queue.cc:260] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:45.697404 23027 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet fd7256acb2114935922b69da9bc94209 (table default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fd7256acb2114935922b69da9bc94209 consensus state has no leader
I20260807 11:08:45.697610 24261 ts_tablet_manager.cc:1428] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260807 11:08:45.700958 24261 tablet_bootstrap.cc:492] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:45.706074 24262 tablet_bootstrap.cc:492] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:45.706485 24262 ts_tablet_manager.cc:1397] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.010s
I20260807 11:08:45.709640 23581 tablet_service.cc:1467] Processing CreateTablet for tablet fd7256acb2114935922b69da9bc94209 (DEFAULT_TABLE table=default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.716229 24261 tablet_bootstrap.cc:654] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:45.717463 23510 leader_election.cc:341] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:45.718809 24247 tablet_replica.cc:330] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:45.720503 24247 raft_consensus.cc:2229] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:45.721135 24247 raft_consensus.cc:2258] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:45.715147 24252 log.cc:1196] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/612c4e9a831f41ddb3304ad0f9a7c949
I20260807 11:08:45.722363 24252 ts_tablet_manager.cc:1939] T 612c4e9a831f41ddb3304ad0f9a7c949 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:45.724092 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 5505cb8da7ce474ea3a8dff33ea0af56 (table default.Table_316461991c264cbd81b1947ff9cdb06a [id=022b0768d03845f89e05a4206d49ff01]) successfully deleted
I20260807 11:08:45.728235 24262 raft_consensus.cc:348] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:45.728436 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 (DEFAULT_TABLE table=default.Table_3c7ba7b38d804dce82d12b1709901e65 [id=741b1ed419a64bbe97e563dc541cb876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.728992 24262 raft_consensus.cc:374] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.729238 24262 raft_consensus.cc:729] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.730146 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c3fdae8df247e5b19a2bd8ffdeec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.729925 24262 consensus_queue.cc:260] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:45.731979 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 (DEFAULT_TABLE table=default.Table_5625af41495d4859b5a3521bf740e72a [id=2353f55fa7e149748a100664634353bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.730507 24266 raft_consensus.cc:348] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.733112 24266 raft_consensus.cc:374] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:45.733596 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cbe28c4d9bf47258c0f694e21e00b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.733561 24266 raft_consensus.cc:729] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:45.739849 24013 tablet_service.cc:1467] Processing CreateTablet for tablet fd7256acb2114935922b69da9bc94209 (DEFAULT_TABLE table=default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.741842 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd7256acb2114935922b69da9bc94209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.744433 24021 tablet_service.cc:1467] Processing CreateTablet for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (DEFAULT_TABLE table=default.Table_6af69aaf5147422597a579fe9a2ccd87 [id=97fa5c597042473aac2865ebebf63541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.757731 24262 ts_tablet_manager.cc:1428] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.051s user 0.000s sys 0.007s
I20260807 11:08:45.758076 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7d0d889f2541a9a5c3c45f1c39df06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.759382 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd7256acb2114935922b69da9bc94209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.771646 24262 tablet_bootstrap.cc:492] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:45.793407 24262 tablet_bootstrap.cc:654] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:45.795332 24271 raft_consensus.cc:482] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:45.796032 24271 raft_consensus.cc:504] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.801105 24271 leader_election.cc:288] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:45.801661 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a693730d9540049fda960d351425e3" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:45.803332 23510 leader_election.cc:341] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:45.765765 24252 tablet_replica.cc:330] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:45.804802 24252 raft_consensus.cc:2229] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:45.805127 23809 tablet_service.cc:1467] Processing CreateTablet for tablet fd7256acb2114935922b69da9bc94209 (DEFAULT_TABLE table=default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:45.805651 24252 raft_consensus.cc:2258] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:45.817081 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a693730d9540049fda960d351425e3" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:45.818347 23616 raft_consensus.cc:2454] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:45.820917 23745 leader_election.cc:302] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:45.822654 24286 raft_consensus.cc:2781] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:45.823084 24286 raft_consensus.cc:482] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:45.823424 24286 raft_consensus.cc:3037] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:45.734529 24266 consensus_queue.cc:260] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:45.825749 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 117815us
I20260807 11:08:45.828764 24252 ts_tablet_manager.cc:1905] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:45.806717 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd7256acb2114935922b69da9bc94209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:45.843184 24266 ts_tablet_manager.cc:1428] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.254s user 0.011s sys 0.000s
I20260807 11:08:45.844624 24266 tablet_bootstrap.cc:492] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:45.850868 24250 ts_tablet_manager.cc:1918] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:45.851459 24250 log.cc:1196] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/5505cb8da7ce474ea3a8dff33ea0af56
I20260807 11:08:45.852349 24250 ts_tablet_manager.cc:1939] T 5505cb8da7ce474ea3a8dff33ea0af56 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:45.853225 24286 raft_consensus.cc:504] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.858986 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a693730d9540049fda960d351425e3" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:45.859768 23616 raft_consensus.cc:3037] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:45.868446 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 612c4e9a831f41ddb3304ad0f9a7c949 (table default.Table_1464bf48282c42ae9b47093453f7db96 [id=4c7601a951374a9aa81371462d6bc20f]) successfully deleted
I20260807 11:08:45.881898 23616 raft_consensus.cc:2454] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:08:45.890523 23745 leader_election.cc:302] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:45.894562 24286 leader_election.cc:288] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:45.895452 24286 raft_consensus.cc:482] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:45.896945 24286 raft_consensus.cc:504] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:45.903873 23951 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 45914us
I20260807 11:08:45.923378 24271 raft_consensus.cc:482] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:45.924139 24271 raft_consensus.cc:504] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:45.928874 24271 leader_election.cc:288] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:45.897713 24247 ts_tablet_manager.cc:1905] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:45.937285 24250 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 20) took 1092 ms. Trace:
I20260807 11:08:45.938360 24250 rpcz_store.cc:276] 0807 11:08:44.844583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:44.847544 (+ 2961us) service_pool.cc:227] Handling call
0807 11:08:45.555683 (+708139us) ts_tablet_manager.cc:1145] Deleting tablet 5505cb8da7ce474ea3a8dff33ea0af56
0807 11:08:45.555810 (+ 127us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:45.762994 (+207184us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:45.850511 (+ 87517us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:45.937183 (+ 86672us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":706936}
I20260807 11:08:45.939492 23037 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_2b93d1fbf5c24e84a94a18ad6d284e10" } new_table_name: "default.Table_3f74892e07884e348597c936e6c04465" modify_external_catalogs: true
I20260807 11:08:45.941152 24250 tablet_replica.cc:330] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:45.942610 24250 raft_consensus.cc:2229] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:45.943662 24250 pending_rounds.cc:62] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Trying to abort 1 pending ops.
I20260807 11:08:45.944079 24250 pending_rounds.cc:68] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869391486189568 op_type: NO_OP noop_request { }
I20260807 11:08:45.943919 23042 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6af69aaf5147422597a579fe9a2ccd87" } new_table_name: "default.Table_26baa80665b44b488686b4462963edea" modify_external_catalogs: true
I20260807 11:08:45.944746 24250 raft_consensus.cc:2866] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:45.945253 24250 raft_consensus.cc:2258] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:45.948091 24250 ts_tablet_manager.cc:1905] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:45.987166 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 5505cb8da7ce474ea3a8dff33ea0af56 (table default.Table_316461991c264cbd81b1947ff9cdb06a [id=022b0768d03845f89e05a4206d49ff01]) successfully deleted
I20260807 11:08:46.002831 24250 ts_tablet_manager.cc:1918] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:46.004667 24250 log.cc:1196] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/327d0c0dd3fa46c296c21d7cc79e368c
I20260807 11:08:46.009586 24367 raft_consensus.cc:2781] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:46.009366 24250 ts_tablet_manager.cc:1939] T 327d0c0dd3fa46c296c21d7cc79e368c P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:46.011732 24366 raft_consensus.cc:482] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:46.012308 24366 raft_consensus.cc:504] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.013921 24250 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 21) took 1062 ms. Trace:
I20260807 11:08:46.018491 24366 leader_election.cc:288] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:46.021456 24250 rpcz_store.cc:276] 0807 11:08:44.951751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:44.952329 (+ 578us) service_pool.cc:227] Handling call
0807 11:08:45.940726 (+988397us) ts_tablet_manager.cc:1145] Deleting tablet 327d0c0dd3fa46c296c21d7cc79e368c
0807 11:08:45.940860 (+ 134us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:45.967752 (+ 26892us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.002554 (+ 34802us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.013839 (+ 11285us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":987776}
I20260807 11:08:46.024647 24250 tablet_replica.cc:330] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:46.026081 24250 raft_consensus.cc:2229] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.026836 24250 raft_consensus.cc:2258] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.041863 24250 ts_tablet_manager.cc:1905] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.046638 24266 tablet_bootstrap.cc:654] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.051208 24261 tablet_bootstrap.cc:492] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:46.051631 24261 ts_tablet_manager.cc:1397] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.351s user 0.077s sys 0.117s
I20260807 11:08:46.054090 24261 raft_consensus.cc:348] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.054750 24261 raft_consensus.cc:374] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.055055 24261 raft_consensus.cc:729] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.055621 24361 raft_consensus.cc:482] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:46.056311 24361 raft_consensus.cc:504] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:46.058986 24261 consensus_queue.cc:260] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.062243 24261 ts_tablet_manager.cc:1428] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 11:08:46.063150 24261 tablet_bootstrap.cc:492] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:46.074505 24261 tablet_bootstrap.cc:654] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.086369 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d34369003a846c6aa0b6ac22177f6b2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:46.090035 23954 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 580320us
W20260807 11:08:46.091603 23510 leader_election.cc:341] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:46.093035 24250 ts_tablet_manager.cc:1918] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.093609 24250 log.cc:1196] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/0d34369003a846c6aa0b6ac22177f6b2
I20260807 11:08:46.094429 24250 ts_tablet_manager.cc:1939] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:46.099035 24262 tablet_bootstrap.cc:492] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:46.099472 24262 ts_tablet_manager.cc:1397] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.328s user 0.007s sys 0.034s
I20260807 11:08:46.088253 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 327d0c0dd3fa46c296c21d7cc79e368c (table default.Table_49f9a17fe8784347a0d0905f8b12e0c8 [id=be75698d1fc146089a8005ded7efe6de]) successfully deleted
I20260807 11:08:46.104444 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 0d34369003a846c6aa0b6ac22177f6b2 (table default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]) successfully deleted
W20260807 11:08:46.105039 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet b677f3eac3f14f848a621e5b21e2393e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b677f3eac3f14f848a621e5b21e2393e already in progress: creating tablet
I20260807 11:08:46.111310 24361 leader_election.cc:288] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:46.132488 24361 raft_consensus.cc:482] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:46.133086 24361 raft_consensus.cc:504] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:46.135203 23954 leader_election.cc:341] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 5505cb8da7ce474ea3a8dff33ea0af56
I20260807 11:08:46.145081 24361 leader_election.cc:288] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:46.023216 24286 leader_election.cc:288] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:08:46.155287 23951 leader_election.cc:341] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5505cb8da7ce474ea3a8dff33ea0af56
I20260807 11:08:46.024549 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a693730d9540049fda960d351425e3" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:46.155997 23951 leader_election.cc:302] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:46.157670 24361 raft_consensus.cc:2726] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:46.159056 24367 raft_consensus.cc:686] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:08:46.179325 23040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 17c3fdae8df247e5b19a2bd8ffdeec98
I20260807 11:08:46.181932 23040 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:53338 (request call id 53) took 1016 ms. Trace:
I20260807 11:08:46.162041 24367 consensus_queue.cc:237] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:46.162509 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 272133us
I20260807 11:08:46.193393 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d81c13089a44af8eb29400e0de721c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:46.194257 23616 raft_consensus.cc:2454] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:46.191470 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d34369003a846c6aa0b6ac22177f6b2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:46.199177 23844 raft_consensus.cc:2454] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:46.205355 24261 tablet_bootstrap.cc:492] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:46.205951 24261 ts_tablet_manager.cc:1397] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.143s user 0.039s sys 0.043s
I20260807 11:08:46.207094 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "327d0c0dd3fa46c296c21d7cc79e368c" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:46.209488 24261 raft_consensus.cc:348] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:46.209720 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:46.210171 24261 raft_consensus.cc:374] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.211588 24261 raft_consensus.cc:729] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.212201 24261 consensus_queue.cc:260] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
W20260807 11:08:46.214905 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17c3fdae8df247e5b19a2bd8ffdeec98 already in progress: creating tablet
I20260807 11:08:46.215317 24266 tablet_bootstrap.cc:492] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:46.215912 24266 ts_tablet_manager.cc:1397] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.372s user 0.017s sys 0.008s
I20260807 11:08:46.217796 23507 leader_election.cc:302] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
W20260807 11:08:46.218976 23507 raft_consensus.cc:2670] T 0d34369003a846c6aa0b6ac22177f6b2 P 8a668588fabb4a9eba107cd6020f1e93: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 11:08:46.219975 24262 raft_consensus.cc:348] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.220654 24262 raft_consensus.cc:374] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.220904 24262 raft_consensus.cc:729] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.221515 24262 consensus_queue.cc:260] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.222224 24261 ts_tablet_manager.cc:1428] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.016s user 0.001s sys 0.006s
W20260807 11:08:46.223884 23951 leader_election.cc:341] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Illegal state: Tablet not RUNNING: STOPPED
I20260807 11:08:46.229450 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:46.230485 24261 tablet_bootstrap.cc:492] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:46.236677 23745 leader_election.cc:302] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:08:46.175630 23027 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 -> Peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Couldn't send request to peer b43b3e5203ee4ac3a23fa1902356994b. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 11:08:46.238106 23027 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 62585.5us
I20260807 11:08:46.245114 24368 raft_consensus.cc:2781] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:46.245764 24368 raft_consensus.cc:482] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:46.246464 24368 raft_consensus.cc:3037] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:46.248907 24261 tablet_bootstrap.cc:654] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.251566 24252 ts_tablet_manager.cc:1918] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260807 11:08:46.251686 23954 leader_election.cc:341] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 327d0c0dd3fa46c296c21d7cc79e368c
I20260807 11:08:46.252116 24252 log.cc:1196] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/46dcd20b44b2493b84ef115a546ef215
I20260807 11:08:46.252476 23954 leader_election.cc:302] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:46.253175 24252 ts_tablet_manager.cc:1939] T 46dcd20b44b2493b84ef115a546ef215 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:46.226696 24266 raft_consensus.cc:348] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.255195 24266 raft_consensus.cc:374] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.248265 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:46.250025 24262 ts_tablet_manager.cc:1428] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.150s user 0.008s sys 0.001s
I20260807 11:08:46.255511 24266 raft_consensus.cc:729] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.256356 24262 tablet_bootstrap.cc:492] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:46.261075 24266 consensus_queue.cc:260] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.262576 24361 raft_consensus.cc:2726] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:08:46.262488 23745 leader_election.cc:341] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 0d34369003a846c6aa0b6ac22177f6b2
I20260807 11:08:46.267813 24261 tablet_bootstrap.cc:492] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:46.268241 24261 ts_tablet_manager.cc:1397] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.015s
I20260807 11:08:46.271104 24271 consensus_queue.cc:1035] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:46.274266 24266 ts_tablet_manager.cc:1428] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.058s user 0.006s sys 0.004s
I20260807 11:08:46.275324 24261 raft_consensus.cc:348] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.275977 24261 raft_consensus.cc:374] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.276225 24261 raft_consensus.cc:729] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.286300 24266 tablet_bootstrap.cc:492] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:46.290548 23507 leader_election.cc:302] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:46.291639 24271 raft_consensus.cc:2726] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:46.292397 24261 consensus_queue.cc:260] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.293324 23036 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 93a693730d9540049fda960d351425e3
I20260807 11:08:46.293366 24252 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 21) took 1454 ms. Trace:
I20260807 11:08:46.293710 24252 rpcz_store.cc:276] 0807 11:08:44.839224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:44.839412 (+ 188us) service_pool.cc:227] Handling call
0807 11:08:45.765556 (+926144us) ts_tablet_manager.cc:1145] Deleting tablet 46dcd20b44b2493b84ef115a546ef215
0807 11:08:45.765620 (+ 64us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:46.122104 (+356484us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.251212 (+129108us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.293284 (+ 42072us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37592,"tablet-delete.queue_time_us":925436}
I20260807 11:08:46.300168 24261 ts_tablet_manager.cc:1428] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.032s user 0.006s sys 0.002s
I20260807 11:08:46.301246 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 93a693730d9540049fda960d351425e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:46.301608 24262 tablet_bootstrap.cc:654] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.301965 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 93a693730d9540049fda960d351425e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:46.302758 24250 tablet_replica.cc:330] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:46.303411 24261 tablet_bootstrap.cc:492] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:46.303522 24250 raft_consensus.cc:2229] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.304004 24250 raft_consensus.cc:2258] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.304235 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d34369003a846c6aa0b6ac22177f6b2 with delete_type TABLET_DATA_DELETED (replaced by tablet c2049735828546ac9a996d26f6119127) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:46.305788 24250 ts_tablet_manager.cc:1905] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.182399 23040 rpcz_store.cc:276] 0807 11:08:45.166053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:45.166196 (+ 143us) service_pool.cc:227] Handling call
0807 11:08:45.168056 (+ 1860us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 11:08:45.188383 (+ 20327us) catalog_manager.cc:2752] Modifying in-memory table state
0807 11:08:45.188546 (+ 163us) catalog_manager.cc:2761] Locking tablets
0807 11:08:45.528456 (+339910us) catalog_manager.cc:2775] Removing table and tablets from system table
0807 11:08:46.178130 (+649674us) catalog_manager.cc:2793] Removing table from by-name map
0807 11:08:46.178567 (+ 437us) catalog_manager.cc:2809] Committing in-memory state
0807 11:08:46.178864 (+ 297us) catalog_manager.cc:2813] Aborting table tasks
0807 11:08:46.181865 (+ 3001us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:45.665765 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:45.666122 (+ 357us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:45.666144 (+ 22us) write_op.cc:435] Acquired schema lock
0807 11:08:45.666156 (+ 12us) tablet.cc:660] Decoding operations
0807 11:08:45.666453 (+ 297us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:45.666487 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:45.666508 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0807 11:08:45.688511 (+ 22003us) tablet.cc:699] Row locks acquired
0807 11:08:45.688526 (+ 15us) write_op.cc:260] PREPARE: finished
0807 11:08:45.688650 (+ 124us) write_op.cc:270] Start()
0807 11:08:45.688768 (+ 118us) write_op.cc:276] Timestamp: P: 1786100925688552 usec, L: 0
0807 11:08:45.688784 (+ 16us) op_driver.cc:331] REPLICATION: starting
0807 11:08:45.698347 (+ 9563us) log.cc:842] Serialized 733 byte log entry
0807 11:08:46.112062 (+413715us) op_driver.cc:444] REPLICATION: finished
0807 11:08:46.119428 (+ 7366us) write_op.cc:301] APPLY: starting
0807 11:08:46.119541 (+ 113us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:46.119737 (+ 196us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:46.119910 (+ 173us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:46.120205 (+ 295us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:46.120456 (+ 251us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 11:08:46.120592 (+ 136us) write_op.cc:312] APPLY: finished
0807 11:08:46.120910 (+ 318us) log.cc:842] Serialized 28 byte log entry
0807 11:08:46.176439 (+ 55529us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:46.176556 (+ 117us) write_op.cc:454] Released schema lock
0807 11:08:46.176616 (+ 60us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":7152,"apply.run_cpu_time_us":2737,"apply.run_wall_time_us":107774,"num_ops":2,"prepare.queue_time_us":116906,"prepare.run_cpu_time_us":2220,"prepare.run_wall_time_us":32875,"raft.queue_time_us":198,"raft.run_cpu_time_us":16,"raft.run_wall_time_us":16,"replication_time_us":423145,"threads_started":1}]]}
I20260807 11:08:46.314888 24261 tablet_bootstrap.cc:654] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.317170 23043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 2894fd38844b446f978022b8a1e5b2df
I20260807 11:08:46.320567 23043 catalog_manager.cc:6565] ReplaceTablet: tablet 2894fd38844b446f978022b8a1e5b2df deleted and replaced by tablet e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:46.320909 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_71a5242b424247f7bd8bc0f937800b71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:46.324040 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 2894fd38844b446f978022b8a1e5b2df with delete_type TABLET_DATA_DELETED (replaced by tablet e254839412ad42fcb6d2e22110d5ee24) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:46.324083 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_94e16611ae8443e08052b5dc61520b02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:46.326066 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 46dcd20b44b2493b84ef115a546ef215 (table default.Table_48a68415bdce41348c38732cfe17762d [id=1d96f575ea9747ca9ffcffe946c858ac]) successfully deleted
I20260807 11:08:46.298648 24247 ts_tablet_manager.cc:1918] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.327967 24252 tablet_replica.cc:330] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:46.328893 24252 raft_consensus.cc:2229] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.330642 24252 raft_consensus.cc:2258] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.331939 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 2894fd38844b446f978022b8a1e5b2df with delete_type TABLET_DATA_DELETED (replaced by tablet e254839412ad42fcb6d2e22110d5ee24) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:46.329722 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet 93a693730d9540049fda960d351425e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:46.336388 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71a5242b424247f7bd8bc0f937800b71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:46.352110 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94e16611ae8443e08052b5dc61520b02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:46.355985 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a693730d9540049fda960d351425e3" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:46.358785 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d81c13089a44af8eb29400e0de721c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:46.362795 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93a693730d9540049fda960d351425e3" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:46.364588 23037 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd720024e90344a7a419a5293d742b22 consensus state has no leader
I20260807 11:08:46.368695 23035 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_f5e8a4f3260848b5938f8c5a9ca968f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:46.371932 23035 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5e8a4f3260848b5938f8c5a9ca968f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:46.375159 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet 2894fd38844b446f978022b8a1e5b2df with delete_type TABLET_DATA_DELETED (replaced by tablet e254839412ad42fcb6d2e22110d5ee24) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:46.330330 24247 log.cc:1196] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/327d0c0dd3fa46c296c21d7cc79e368c
I20260807 11:08:46.379521 24247 ts_tablet_manager.cc:1939] T 327d0c0dd3fa46c296c21d7cc79e368c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
W20260807 11:08:46.381311 23745 leader_election.cc:341] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:46.382829 23745 leader_election.cc:341] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:46.383039 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 327d0c0dd3fa46c296c21d7cc79e368c (table default.Table_49f9a17fe8784347a0d0905f8b12e0c8 [id=be75698d1fc146089a8005ded7efe6de]) successfully deleted
W20260807 11:08:46.393373 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17c3fdae8df247e5b19a2bd8ffdeec98 already in progress: creating tablet
I20260807 11:08:46.396059 24247 tablet_replica.cc:330] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
W20260807 11:08:46.396198 23745 leader_election.cc:341] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:46.394659 24368 raft_consensus.cc:504] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.402272 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d34369003a846c6aa0b6ac22177f6b2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:46.403273 24058 raft_consensus.cc:2454] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:46.405165 24368 leader_election.cc:288] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:46.407069 24247 raft_consensus.cc:2229] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.407927 24247 raft_consensus.cc:2258] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.411830 24247 ts_tablet_manager.cc:1905] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.411540 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_0734c6da9f9e477098985611bb0b0f13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:46.417809 24271 consensus_queue.cc:1035] T 1f3d4571045043eb8ec87b5f31871a09 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:46.437638 24247 ts_tablet_manager.cc:1918] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.438246 24247 log.cc:1196] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/0d34369003a846c6aa0b6ac22177f6b2
I20260807 11:08:46.439285 24247 ts_tablet_manager.cc:1939] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:46.442235 24247 tablet_replica.cc:330] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:46.445983 24247 raft_consensus.cc:2229] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:46.447264 24247 pending_rounds.cc:62] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Trying to abort 1 pending ops.
I20260807 11:08:46.447557 24247 pending_rounds.cc:68] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869393668628480 op_type: NO_OP noop_request { }
I20260807 11:08:46.448096 24247 raft_consensus.cc:2866] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:46.448472 24247 raft_consensus.cc:2258] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.452659 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d81c13089a44af8eb29400e0de721c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:46.453384 23616 raft_consensus.cc:3037] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:46.456349 24247 ts_tablet_manager.cc:1905] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.455767 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d81c13089a44af8eb29400e0de721c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:46.469970 23745 leader_election.cc:302] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93
I20260807 11:08:46.471015 23616 raft_consensus.cc:2454] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:08:46.472617 24368 raft_consensus.cc:482] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:46.473348 24368 raft_consensus.cc:504] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:46.450382 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 0d34369003a846c6aa0b6ac22177f6b2 (table default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]) successfully deleted
W20260807 11:08:46.475582 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 52540.5us
I20260807 11:08:46.476752 24368 leader_election.cc:288] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:46.477752 24252 ts_tablet_manager.cc:1905] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:46.487020 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0734c6da9f9e477098985611bb0b0f13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:46.495129 23042 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc7d0d889f2541a9a5c3c45f1c39df06 consensus state has no leader
W20260807 11:08:46.501068 23745 raft_consensus.cc:2670] T 0d34369003a846c6aa0b6ac22177f6b2 P 99a8d4e2c1b14150b03ad0f28e74a011: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260807 11:08:46.505062 23745 leader_election.cc:341] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:46.485585 24266 tablet_bootstrap.cc:654] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.537309 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_43b786b7fa8344208e879227a685c889" } modify_external_catalogs: true
I20260807 11:08:46.549252 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_43b786b7fa8344208e879227a685c889" } modify_external_catalogs: true
I20260807 11:08:46.538765 23048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a3768b2e5463473f87677e7b739b90d8" } modify_external_catalogs: true
I20260807 11:08:46.550431 23048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a3768b2e5463473f87677e7b739b90d8" } modify_external_catalogs: true
I20260807 11:08:46.556943 23046 master_service.cc:946] ReplaceTablet: received request to replace tablet bd720024e90344a7a419a5293d742b22 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:46.567896 24261 tablet_bootstrap.cc:492] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:46.568326 24261 ts_tablet_manager.cc:1397] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.265s user 0.024s sys 0.036s
I20260807 11:08:46.572530 24261 raft_consensus.cc:348] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.573267 24261 raft_consensus.cc:374] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.573513 24261 raft_consensus.cc:729] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.574385 24261 consensus_queue.cc:260] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.534838 24247 ts_tablet_manager.cc:1918] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:46.580791 24247 log.cc:1196] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/93a693730d9540049fda960d351425e3
I20260807 11:08:46.581727 24247 ts_tablet_manager.cc:1939] T 93a693730d9540049fda960d351425e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:46.596447 24261 ts_tablet_manager.cc:1428] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.028s user 0.009s sys 0.000s
W20260807 11:08:46.587056 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 82261.1us
I20260807 11:08:46.597551 24368 raft_consensus.cc:482] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:46.598125 24368 raft_consensus.cc:504] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.598557 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2894fd38844b446f978022b8a1e5b2df" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:46.599629 23037 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a1a0d2467a984aa09f3450da197f285c" } new_table_name: "default.Table_a536193b9fc2446c9cfad81487d26c97" modify_external_catalogs: true
I20260807 11:08:46.601496 24368 leader_election.cc:288] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:46.606264 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2894fd38844b446f978022b8a1e5b2df" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:46.606935 23616 raft_consensus.cc:2454] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:46.613577 24261 tablet_bootstrap.cc:492] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:46.618033 23745 leader_election.cc:302] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:46.619535 24368 raft_consensus.cc:2781] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:46.620236 24368 raft_consensus.cc:686] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:08:46.621608 24368 consensus_queue.cc:237] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.628697 24247 tablet_replica.cc:330] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:46.629168 24262 tablet_bootstrap.cc:492] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:46.628801 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 93a693730d9540049fda960d351425e3 (table default.Table_83665ed20c9240c790c6ebe6ca706e6f [id=7454612b977146668cdbbaab7a5baee7]) successfully deleted
I20260807 11:08:46.629573 24262 ts_tablet_manager.cc:1397] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.373s user 0.011s sys 0.010s
I20260807 11:08:46.629801 24247 raft_consensus.cc:2229] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.630282 24247 raft_consensus.cc:2258] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.631953 24262 raft_consensus.cc:348] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.632704 24262 raft_consensus.cc:374] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.632946 24262 raft_consensus.cc:729] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.633673 24262 consensus_queue.cc:260] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.635601 24262 ts_tablet_manager.cc:1428] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 11:08:46.639216 24247 ts_tablet_manager.cc:1905] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.636546 24262 tablet_bootstrap.cc:492] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:46.653455 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 65842.2us
I20260807 11:08:46.654888 23745 leader_election.cc:302] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:08:46.656183 23745 raft_consensus.cc:2670] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 11:08:46.658595 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a046eb45bf4d619008ead6f6580713" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:46.659260 23616 raft_consensus.cc:2454] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
W20260807 11:08:46.693041 23745 leader_election.cc:341] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:46.702982 23027 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet fd7256acb2114935922b69da9bc94209 (table default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fd7256acb2114935922b69da9bc94209 consensus state has no leader
I20260807 11:08:46.707454 23809 tablet_service.cc:1467] Processing CreateTablet for tablet c2049735828546ac9a996d26f6119127 (DEFAULT_TABLE table=default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.708964 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2049735828546ac9a996d26f6119127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.713452 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd (DEFAULT_TABLE table=default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.714601 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_06348463068444bfa120534ced7a9e25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:46.715083 23581 tablet_service.cc:1467] Processing CreateTablet for tablet c2049735828546ac9a996d26f6119127 (DEFAULT_TABLE table=default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.716619 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2049735828546ac9a996d26f6119127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.714831 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40f0051d83e34bd2ae40986f45b0b8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.716200 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd (DEFAULT_TABLE table=default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.719940 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40f0051d83e34bd2ae40986f45b0b8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.720609 24261 tablet_bootstrap.cc:654] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.729725 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 3430075bbedd48efbcd78cf6806623ac (DEFAULT_TABLE table=default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.730566 23048 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 402e8db9bc6a461384a13b942ead6637
I20260807 11:08:46.731630 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3430075bbedd48efbcd78cf6806623ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.735468 23745 leader_election.cc:302] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:46.738281 24368 raft_consensus.cc:2781] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:46.738883 24368 raft_consensus.cc:482] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 11:08:46.739250 23037 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdaf60bc130e4a84b7a309eec3109d61 has no consensus state
I20260807 11:08:46.739411 24368 raft_consensus.cc:3037] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:46.741953 24262 tablet_bootstrap.cc:654] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.741863 23042 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 31cbf0be8e2448ef873b6546d5ff9038
W20260807 11:08:46.718650 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06348463068444bfa120534ced7a9e25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:46.752720 23045 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:53338 (request call id 59) took 1292 ms. Trace:
I20260807 11:08:46.753279 23045 rpcz_store.cc:276] 0807 11:08:45.460491 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:45.460613 (+ 122us) service_pool.cc:227] Handling call
0807 11:08:46.752626 (+1292013us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1083136}
I20260807 11:08:46.757475 23036 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_79a7000df23c40f4b9b2ca741893f1f4 [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 1 got 0
I20260807 11:08:46.761111 24368 raft_consensus.cc:504] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.763123 23035 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6fea2efc5c174bc18527ba33443d3a55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:46.764575 24367 raft_consensus.cc:482] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:46.765218 24367 raft_consensus.cc:504] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:46.766140 23035 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fea2efc5c174bc18527ba33443d3a55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:46.768993 24367 leader_election.cc:288] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:08:46.765383 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 70993.3us
I20260807 11:08:46.771838 23043 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_79a7000df23c40f4b9b2ca741893f1f4 [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 1 got 0
I20260807 11:08:46.782248 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_5625af41495d4859b5a3521bf740e72a" } new_table_name: "default.Table_c8245140e191479a8dbca50ad401db93" modify_external_catalogs: true
I20260807 11:08:46.793416 24262 tablet_bootstrap.cc:492] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:46.793821 24262 ts_tablet_manager.cc:1397] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.158s user 0.007s sys 0.010s
I20260807 11:08:46.800521 24262 raft_consensus.cc:348] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.801185 24262 raft_consensus.cc:374] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.801434 24262 raft_consensus.cc:729] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.801340 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a046eb45bf4d619008ead6f6580713" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:46.802932 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd (DEFAULT_TABLE table=default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.804279 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40f0051d83e34bd2ae40986f45b0b8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.807806 24013 tablet_service.cc:1467] Processing CreateTablet for tablet c2049735828546ac9a996d26f6119127 (DEFAULT_TABLE table=default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.808970 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2049735828546ac9a996d26f6119127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.809945 24247 ts_tablet_manager.cc:1918] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.810292 24247 log.cc:1196] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/2894fd38844b446f978022b8a1e5b2df
I20260807 11:08:46.810871 24247 ts_tablet_manager.cc:1939] T 2894fd38844b446f978022b8a1e5b2df P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:46.811555 24021 tablet_service.cc:1467] Processing CreateTablet for tablet 3430075bbedd48efbcd78cf6806623ac (DEFAULT_TABLE table=default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.812773 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3430075bbedd48efbcd78cf6806623ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.813216 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 2894fd38844b446f978022b8a1e5b2df (table default.Table_97a8a61ce0154bb2bba0517931520b67 [id=ff1332012e264831adffc1c10a065f50]) successfully deleted
I20260807 11:08:46.815943 23046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet bd720024e90344a7a419a5293d742b22
I20260807 11:08:46.817642 23046 catalog_manager.cc:6565] ReplaceTablet: tablet bd720024e90344a7a419a5293d742b22 deleted and replaced by tablet 9d7dd489496d45ca96d3cdac239e8713
I20260807 11:08:46.818472 23813 tablet_service.cc:1514] Processing DeleteTablet for tablet bd720024e90344a7a419a5293d742b22 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d7dd489496d45ca96d3cdac239e8713) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:46.819387 24368 leader_election.cc:288] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:46.822006 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b677f3eac3f14f848a621e5b21e2393e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:46.825230 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 3430075bbedd48efbcd78cf6806623ac (DEFAULT_TABLE table=default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:46.826426 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet bd720024e90344a7a419a5293d742b22 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d7dd489496d45ca96d3cdac239e8713) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:46.828882 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet bd720024e90344a7a419a5293d742b22 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d7dd489496d45ca96d3cdac239e8713) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:46.828966 24262 consensus_queue.cc:260] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.830633 24266 tablet_bootstrap.cc:492] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:46.831027 24262 ts_tablet_manager.cc:1428] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.037s user 0.005s sys 0.004s
I20260807 11:08:46.831058 24266 ts_tablet_manager.cc:1397] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.545s user 0.004s sys 0.011s
I20260807 11:08:46.832001 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet 93a693730d9540049fda960d351425e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:46.834920 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b677f3eac3f14f848a621e5b21e2393e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:46.835836 23616 raft_consensus.cc:2454] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:46.836681 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3430075bbedd48efbcd78cf6806623ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:46.839785 24250 ts_tablet_manager.cc:1918] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.840248 24250 log.cc:1196] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/93a693730d9540049fda960d351425e3
I20260807 11:08:46.841006 24250 ts_tablet_manager.cc:1939] T 93a693730d9540049fda960d351425e3 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:46.844019 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet 2894fd38844b446f978022b8a1e5b2df with delete_type TABLET_DATA_DELETED (replaced by tablet e254839412ad42fcb6d2e22110d5ee24) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:46.851554 24250 tablet_replica.cc:330] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:46.851732 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 93a693730d9540049fda960d351425e3 (table default.Table_83665ed20c9240c790c6ebe6ca706e6f [id=7454612b977146668cdbbaab7a5baee7]) successfully deleted
I20260807 11:08:46.852217 24250 raft_consensus.cc:2229] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.852622 24250 raft_consensus.cc:2258] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.854167 24250 ts_tablet_manager.cc:1905] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.876271 24252 ts_tablet_manager.cc:1918] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.879391 24252 log.cc:1196] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/327d0c0dd3fa46c296c21d7cc79e368c
I20260807 11:08:46.880589 24252 ts_tablet_manager.cc:1939] T 327d0c0dd3fa46c296c21d7cc79e368c P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:46.884191 24252 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 22) took 1927 ms. Trace:
I20260807 11:08:46.884773 24252 rpcz_store.cc:276] 0807 11:08:44.957170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:44.957312 (+ 142us) service_pool.cc:227] Handling call
0807 11:08:46.327775 (+1370463us) ts_tablet_manager.cc:1145] Deleting tablet 327d0c0dd3fa46c296c21d7cc79e368c
0807 11:08:46.327825 (+ 50us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:46.863976 (+536151us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.875983 (+ 12007us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.884110 (+ 8127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1369488}
I20260807 11:08:46.886709 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 327d0c0dd3fa46c296c21d7cc79e368c (table default.Table_49f9a17fe8784347a0d0905f8b12e0c8 [id=be75698d1fc146089a8005ded7efe6de]) successfully deleted
I20260807 11:08:46.887619 24247 tablet_replica.cc:330] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:46.888052 24252 tablet_replica.cc:330] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:46.888281 24247 raft_consensus.cc:2229] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.888686 24247 raft_consensus.cc:2258] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.889638 24252 raft_consensus.cc:2229] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.890179 24262 tablet_bootstrap.cc:492] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:46.890321 24252 raft_consensus.cc:2258] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.893100 24247 ts_tablet_manager.cc:1905] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.893576 24252 ts_tablet_manager.cc:1905] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.834532 24266 raft_consensus.cc:348] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.897105 24266 raft_consensus.cc:374] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:46.897379 24266 raft_consensus.cc:729] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:46.898168 24266 consensus_queue.cc:260] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:46.922346 24252 ts_tablet_manager.cc:1918] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.922941 24252 log.cc:1196] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/5505cb8da7ce474ea3a8dff33ea0af56
I20260807 11:08:46.923878 24252 ts_tablet_manager.cc:1939] T 5505cb8da7ce474ea3a8dff33ea0af56 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:46.924520 24262 tablet_bootstrap.cc:654] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:46.926152 24266 ts_tablet_manager.cc:1428] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.095s user 0.006s sys 0.000s
I20260807 11:08:46.927039 24252 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 26) took 1611 ms. Trace:
I20260807 11:08:46.927573 24252 rpcz_store.cc:276] 0807 11:08:45.315826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:45.317602 (+ 1776us) service_pool.cc:227] Handling call
0807 11:08:46.887693 (+1570091us) ts_tablet_manager.cc:1145] Deleting tablet 5505cb8da7ce474ea3a8dff33ea0af56
0807 11:08:46.887763 (+ 70us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:46.910242 (+ 22479us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.922109 (+ 11867us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.926958 (+ 4849us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1569370}
I20260807 11:08:46.929461 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 5505cb8da7ce474ea3a8dff33ea0af56 (table default.Table_316461991c264cbd81b1947ff9cdb06a [id=022b0768d03845f89e05a4206d49ff01]) successfully deleted
I20260807 11:08:46.930581 24252 tablet_replica.cc:330] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:46.931800 24252 raft_consensus.cc:2229] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:46.932458 24252 raft_consensus.cc:2258] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:46.934952 24252 ts_tablet_manager.cc:1905] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:46.939990 23036 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_3f74892e07884e348597c936e6c04465" } modify_external_catalogs: true
I20260807 11:08:46.940892 23036 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_3f74892e07884e348597c936e6c04465" } modify_external_catalogs: true
I20260807 11:08:46.943845 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_a2648147880248d294c63834c8c7ca84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:46.948751 24250 ts_tablet_manager.cc:1918] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.949079 24250 log.cc:1196] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/2894fd38844b446f978022b8a1e5b2df
I20260807 11:08:46.949646 24250 ts_tablet_manager.cc:1939] T 2894fd38844b446f978022b8a1e5b2df P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
W20260807 11:08:46.951951 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2648147880248d294c63834c8c7ca84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:46.954110 23040 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_97a8a61ce0154bb2bba0517931520b67" } new_table_name: "default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4" modify_external_catalogs: true
I20260807 11:08:46.955189 24247 ts_tablet_manager.cc:1918] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:46.955113 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a7658071bcf140b7a98557dffc8a9289" } modify_external_catalogs: true
I20260807 11:08:46.955554 24247 log.cc:1196] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/bd720024e90344a7a419a5293d742b22
I20260807 11:08:46.955729 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a7658071bcf140b7a98557dffc8a9289" } modify_external_catalogs: true
I20260807 11:08:46.956135 24247 ts_tablet_manager.cc:1939] T bd720024e90344a7a419a5293d742b22 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:46.958256 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet bd720024e90344a7a419a5293d742b22 (table default.Table_3f74892e07884e348597c936e6c04465 [id=5319693d27304aa3bac2365055974a3e]) successfully deleted
I20260807 11:08:46.965901 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a046eb45bf4d619008ead6f6580713" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:46.966290 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5cbe28c4d9bf47258c0f694e21e00b21 consensus state has no leader
W20260807 11:08:46.977008 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 93a693730d9540049fda960d351425e3 because the tablet was not found. No further retry: Not found: Tablet not found: 93a693730d9540049fda960d351425e3
W20260807 11:08:46.978729 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 2894fd38844b446f978022b8a1e5b2df because the tablet was not found. No further retry: Not found: Tablet not found: 2894fd38844b446f978022b8a1e5b2df
I20260807 11:08:46.988302 23745 leader_election.cc:302] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:46.989346 24368 raft_consensus.cc:2781] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 11:08:46.989495 23745 leader_election.cc:341] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:46.989784 24368 raft_consensus.cc:482] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:46.990290 24368 raft_consensus.cc:3037] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:46.990983 23745 leader_election.cc:341] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:46.995919 24266 tablet_bootstrap.cc:492] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:47.007630 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a046eb45bf4d619008ead6f6580713" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:47.007557 24368 raft_consensus.cc:504] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.008378 23616 raft_consensus.cc:3037] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:47.011034 24261 tablet_bootstrap.cc:492] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:47.011420 24261 ts_tablet_manager.cc:1397] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.398s user 0.012s sys 0.005s
I20260807 11:08:47.011947 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 2894fd38844b446f978022b8a1e5b2df (table default.Table_97a8a61ce0154bb2bba0517931520b67 [id=ff1332012e264831adffc1c10a065f50]) successfully deleted
W20260807 11:08:47.012607 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet bd720024e90344a7a419a5293d742b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd720024e90344a7a419a5293d742b22 already in progress: creating tablet
I20260807 11:08:47.013902 24261 raft_consensus.cc:348] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.014528 24261 raft_consensus.cc:374] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.014768 24261 raft_consensus.cc:729] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:47.015430 24261 consensus_queue.cc:260] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.017393 24261 ts_tablet_manager.cc:1428] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 11:08:47.022841 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_600b8d2dc0da446f8d7a5d207e3485d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:47.025053 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_600b8d2dc0da446f8d7a5d207e3485d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.033026 23616 raft_consensus.cc:2454] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
W20260807 11:08:47.035506 23040 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e254839412ad42fcb6d2e22110d5ee24 has no consensus state
I20260807 11:08:47.041383 24261 tablet_bootstrap.cc:492] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:47.052481 24261 tablet_bootstrap.cc:654] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:47.053858 23040 master_service.cc:946] ReplaceTablet: received request to replace tablet 5cbe28c4d9bf47258c0f694e21e00b21 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:47.068537 23035 master_service.cc:946] ReplaceTablet: received request to replace tablet 5cbe28c4d9bf47258c0f694e21e00b21 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:47.080425 24261 tablet_bootstrap.cc:492] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:47.080822 24261 ts_tablet_manager.cc:1397] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.003s
I20260807 11:08:47.095551 24266 tablet_bootstrap.cc:654] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:47.096148 24368 leader_election.cc:288] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:08:47.103104 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 112189us
W20260807 11:08:47.105281 23745 leader_election.cc:341] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:47.107276 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b677f3eac3f14f848a621e5b21e2393e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:47.107946 23616 raft_consensus.cc:3037] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:47.107954 23745 leader_election.cc:302] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:47.109508 24368 raft_consensus.cc:2781] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:47.094211 24261 raft_consensus.cc:348] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.110878 24261 raft_consensus.cc:374] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.111145 24261 raft_consensus.cc:729] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:47.114002 24368 raft_consensus.cc:686] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:08:47.115094 24261 consensus_queue.cc:260] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.120723 24261 ts_tablet_manager.cc:1428] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.040s user 0.008s sys 0.000s
I20260807 11:08:47.120496 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b677f3eac3f14f848a621e5b21e2393e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:47.115906 24368 consensus_queue.cc:237] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.115976 23616 raft_consensus.cc:2454] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:08:47.124573 24261 tablet_bootstrap.cc:492] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:47.134341 24252 ts_tablet_manager.cc:1918] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:47.134728 24252 log.cc:1196] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/0d34369003a846c6aa0b6ac22177f6b2
I20260807 11:08:47.136771 24252 ts_tablet_manager.cc:1939] T 0d34369003a846c6aa0b6ac22177f6b2 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:47.148635 24261 tablet_bootstrap.cc:654] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:47.150133 24252 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 27) took 1834 ms. Trace:
I20260807 11:08:47.150475 24252 rpcz_store.cc:276] 0807 11:08:45.316371 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:45.318410 (+ 2039us) service_pool.cc:227] Handling call
0807 11:08:46.930390 (+1611980us) ts_tablet_manager.cc:1145] Deleting tablet 0d34369003a846c6aa0b6ac22177f6b2
0807 11:08:46.930448 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:47.053049 (+122601us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:47.134097 (+ 81048us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:47.150070 (+ 15973us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1611228}
I20260807 11:08:47.151690 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 0d34369003a846c6aa0b6ac22177f6b2 (table default.Table_64cd1665df804462ba5435d0610f528d [id=d5c79d7bd03641dda09bcd556f2f64bf]) successfully deleted
I20260807 11:08:47.152107 24252 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 28) took 1835 ms. Trace:
I20260807 11:08:47.152426 24252 rpcz_store.cc:276] 0807 11:08:45.317021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:45.319533 (+ 2512us) service_pool.cc:227] Handling call
0807 11:08:47.151755 (+1832222us) ts_tablet_manager.cc:1145] Deleting tablet b677f3eac3f14f848a621e5b21e2393e
0807 11:08:47.151797 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:47.152056 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1831002}
W20260807 11:08:47.153690 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet b677f3eac3f14f848a621e5b21e2393e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b677f3eac3f14f848a621e5b21e2393e already in progress: creating tablet
I20260807 11:08:47.155062 24393 raft_consensus.cc:482] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:08:47.155263 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17c3fdae8df247e5b19a2bd8ffdeec98 already in progress: creating tablet
I20260807 11:08:47.155489 24393 raft_consensus.cc:504] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:47.156594 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 93a693730d9540049fda960d351425e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93a693730d9540049fda960d351425e3 already in progress: creating tablet
I20260807 11:08:47.157245 24393 leader_election.cc:288] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:08:47.157932 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 2894fd38844b446f978022b8a1e5b2df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2894fd38844b446f978022b8a1e5b2df already in progress: creating tablet
I20260807 11:08:47.158907 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c3fdae8df247e5b19a2bd8ffdeec98" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:47.159380 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet bd720024e90344a7a419a5293d742b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd720024e90344a7a419a5293d742b22 already in progress: creating tablet
W20260807 11:08:47.160282 23510 leader_election.cc:341] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:47.161401 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:47.163244 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.171043 24266 tablet_bootstrap.cc:492] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:47.171546 24266 ts_tablet_manager.cc:1397] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.176s user 0.010s sys 0.005s
I20260807 11:08:47.173923 24266 raft_consensus.cc:348] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.174667 24266 raft_consensus.cc:374] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.175064 24266 raft_consensus.cc:729] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:47.175974 24266 consensus_queue.cc:260] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.176997 23046 catalog_manager.cc:5495] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } }
I20260807 11:08:47.182161 24266 ts_tablet_manager.cc:1428] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260807 11:08:47.186614 24266 tablet_bootstrap.cc:492] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:47.195078 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_17be8288b7444457b34389701b2f2ba7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:47.195595 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_79a7000df23c40f4b9b2ca741893f1f4" } new_table_name: "default.Table_790a627621de44e0a8f5aae06d786d3a" modify_external_catalogs: true
W20260807 11:08:47.196799 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17be8288b7444457b34389701b2f2ba7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.197360 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 3733d4813197446e9ecc8be58f87eda7 (DEFAULT_TABLE table=default.Table_f5e8a4f3260848b5938f8c5a9ca968f6 [id=83e365e8f3f94f6b869152057a8d7212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.198814 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3733d4813197446e9ecc8be58f87eda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.195988 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 3733d4813197446e9ecc8be58f87eda7 (DEFAULT_TABLE table=default.Table_f5e8a4f3260848b5938f8c5a9ca968f6 [id=83e365e8f3f94f6b869152057a8d7212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.205917 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3733d4813197446e9ecc8be58f87eda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.207094 24361 raft_consensus.cc:482] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:47.207569 24361 raft_consensus.cc:504] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.209609 24361 leader_election.cc:288] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:47.212212 23581 tablet_service.cc:1467] Processing CreateTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 (DEFAULT_TABLE table=default.Table_a536193b9fc2446c9cfad81487d26c97 [id=32b96b2f0b644d94aa4ae5432d615506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.213342 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdaf60bc130e4a84b7a309eec3109d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.214145 24013 tablet_service.cc:1467] Processing CreateTablet for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 (DEFAULT_TABLE table=default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.212181 23574 tablet_service.cc:1467] Processing CreateTablet for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 (DEFAULT_TABLE table=default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.215168 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.215576 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.178364 23046 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_79a7000df23c40f4b9b2ca741893f1f4 [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 1 got 0
I20260807 11:08:47.218111 23036 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 9d7dd489496d45ca96d3cdac239e8713
I20260807 11:08:47.219961 24021 tablet_service.cc:1467] Processing CreateTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 (DEFAULT_TABLE table=default.Table_a536193b9fc2446c9cfad81487d26c97 [id=32b96b2f0b644d94aa4ae5432d615506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.221465 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdaf60bc130e4a84b7a309eec3109d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.223573 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d81c13089a44af8eb29400e0de721c" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:47.224718 23616 raft_consensus.cc:2379] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in this term.
I20260807 11:08:47.233048 23036 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_4f45188e40aa49a2845642586546499c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:47.235656 23036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f45188e40aa49a2845642586546499c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.244658 24017 tablet_service.cc:1467] Processing CreateTablet for tablet b62eea967fed4adc84252b8366609878 (DEFAULT_TABLE table=default.Table_71a5242b424247f7bd8bc0f937800b71 [id=16f0e59495a34bddaa4420a6bec3df06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.246420 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b62eea967fed4adc84252b8366609878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.249012 23045 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_f5e8a4f3260848b5938f8c5a9ca968f6" } new_table_name: "default.Table_c22be7feb1a54be89a486e34ca9c7194" modify_external_catalogs: true
I20260807 11:08:47.249256 23580 tablet_service.cc:1467] Processing CreateTablet for tablet b62eea967fed4adc84252b8366609878 (DEFAULT_TABLE table=default.Table_71a5242b424247f7bd8bc0f937800b71 [id=16f0e59495a34bddaa4420a6bec3df06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.250281 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b62eea967fed4adc84252b8366609878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.257758 23040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 5cbe28c4d9bf47258c0f694e21e00b21
I20260807 11:08:47.260151 23040 catalog_manager.cc:6565] ReplaceTablet: tablet 5cbe28c4d9bf47258c0f694e21e00b21 deleted and replaced by tablet 0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:08:47.269071 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 88e76082d4094493a544e18ce9594e20 (DEFAULT_TABLE table=default.Table_94e16611ae8443e08052b5dc61520b02 [id=b7905a38d56448c8b4047f8ec0b6d9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.272399 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 88e76082d4094493a544e18ce9594e20 (DEFAULT_TABLE table=default.Table_94e16611ae8443e08052b5dc61520b02 [id=b7905a38d56448c8b4047f8ec0b6d9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.273692 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e76082d4094493a544e18ce9594e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.270833 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e76082d4094493a544e18ce9594e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.277834 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 with delete_type TABLET_DATA_DELETED (replaced by tablet 0071aac25afa4100b98c4811cf3e6b2e) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.278012 24018 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 with delete_type TABLET_DATA_DELETED (replaced by tablet 0071aac25afa4100b98c4811cf3e6b2e) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:47.279763 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 5cbe28c4d9bf47258c0f694e21e00b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5cbe28c4d9bf47258c0f694e21e00b21 already in progress: creating tablet
I20260807 11:08:47.281570 24018 tablet_service.cc:1467] Processing CreateTablet for tablet e254839412ad42fcb6d2e22110d5ee24 (DEFAULT_TABLE table=default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4 [id=ff1332012e264831adffc1c10a065f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.282783 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e254839412ad42fcb6d2e22110d5ee24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:47.308380 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 5cbe28c4d9bf47258c0f694e21e00b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5cbe28c4d9bf47258c0f694e21e00b21 already in progress: creating tablet
I20260807 11:08:47.309306 23572 tablet_service.cc:1467] Processing CreateTablet for tablet e254839412ad42fcb6d2e22110d5ee24 (DEFAULT_TABLE table=default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4 [id=ff1332012e264831adffc1c10a065f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.309854 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_ea80ebfe1316466fbf771f6c3f93a72b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:47.310580 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e254839412ad42fcb6d2e22110d5ee24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:47.311583 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea80ebfe1316466fbf771f6c3f93a72b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.312191 24261 tablet_bootstrap.cc:492] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:47.312618 24261 ts_tablet_manager.cc:1397] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.188s user 0.014s sys 0.004s
I20260807 11:08:47.314793 24261 raft_consensus.cc:348] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.319510 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet fd7256acb2114935922b69da9bc94209
I20260807 11:08:47.319587 24261 raft_consensus.cc:374] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.319964 24261 raft_consensus.cc:729] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:47.320770 24261 consensus_queue.cc:260] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.325403 24261 ts_tablet_manager.cc:1428] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260807 11:08:47.332835 23571 tablet_service.cc:1514] Processing DeleteTablet for tablet fd7256acb2114935922b69da9bc94209 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:46 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.332886 24012 tablet_service.cc:1514] Processing DeleteTablet for tablet fd7256acb2114935922b69da9bc94209 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:46 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:47.339159 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet fd7256acb2114935922b69da9bc94209 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd7256acb2114935922b69da9bc94209 already in progress: creating tablet
W20260807 11:08:47.339879 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet fd7256acb2114935922b69da9bc94209 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd7256acb2114935922b69da9bc94209 already in progress: creating tablet
I20260807 11:08:47.359604 23803 tablet_service.cc:1514] Processing DeleteTablet for tablet fd7256acb2114935922b69da9bc94209 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:46 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:47.361845 23805 tablet_service.cc:1467] Processing CreateTablet for tablet e254839412ad42fcb6d2e22110d5ee24 (DEFAULT_TABLE table=default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4 [id=ff1332012e264831adffc1c10a065f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.363863 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e254839412ad42fcb6d2e22110d5ee24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.364077 23745 leader_election.cc:302] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:08:47.365423 23745 leader_election.cc:341] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:47.386413 23583 tablet_service.cc:1514] Processing DeleteTablet for tablet 2894fd38844b446f978022b8a1e5b2df with delete_type TABLET_DATA_DELETED (replaced by tablet e254839412ad42fcb6d2e22110d5ee24) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:47.387745 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 2894fd38844b446f978022b8a1e5b2df because the tablet was not found. No further retry: Not found: Tablet not found: 2894fd38844b446f978022b8a1e5b2df
I20260807 11:08:47.387898 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet b677f3eac3f14f848a621e5b21e2393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.388727 24250 tablet_replica.cc:330] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:47.389396 24250 raft_consensus.cc:2229] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:47.389788 24250 raft_consensus.cc:2258] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:47.391376 24250 ts_tablet_manager.cc:1905] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:47.394115 23045 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3733d4813197446e9ecc8be58f87eda7 consensus state has no leader
I20260807 11:08:47.412631 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 with delete_type TABLET_DATA_DELETED (replaced by tablet 0071aac25afa4100b98c4811cf3e6b2e) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:47.413851 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 3733d4813197446e9ecc8be58f87eda7 (DEFAULT_TABLE table=default.Table_f5e8a4f3260848b5938f8c5a9ca968f6 [id=83e365e8f3f94f6b869152057a8d7212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.415768 24250 ts_tablet_manager.cc:1918] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:47.417048 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3733d4813197446e9ecc8be58f87eda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.418402 24250 log.cc:1196] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/b677f3eac3f14f848a621e5b21e2393e
I20260807 11:08:47.422044 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4" } modify_external_catalogs: true
I20260807 11:08:47.422752 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4" } modify_external_catalogs: true
I20260807 11:08:47.423808 24250 ts_tablet_manager.cc:1939] T b677f3eac3f14f848a621e5b21e2393e P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:47.425154 23809 tablet_service.cc:1467] Processing CreateTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 (DEFAULT_TABLE table=default.Table_a536193b9fc2446c9cfad81487d26c97 [id=32b96b2f0b644d94aa4ae5432d615506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.427094 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdaf60bc130e4a84b7a309eec3109d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.437068 23813 tablet_service.cc:1467] Processing CreateTablet for tablet b62eea967fed4adc84252b8366609878 (DEFAULT_TABLE table=default.Table_71a5242b424247f7bd8bc0f937800b71 [id=16f0e59495a34bddaa4420a6bec3df06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.439507 23813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b62eea967fed4adc84252b8366609878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.449682 23816 tablet_service.cc:1467] Processing CreateTablet for tablet 88e76082d4094493a544e18ce9594e20 (DEFAULT_TABLE table=default.Table_94e16611ae8443e08052b5dc61520b02 [id=b7905a38d56448c8b4047f8ec0b6d9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.458024 23816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e76082d4094493a544e18ce9594e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.452842 23818 tablet_service.cc:1467] Processing CreateTablet for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 (DEFAULT_TABLE table=default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.461563 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.457383 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d81c13089a44af8eb29400e0de721c" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:47.448709 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c3fdae8df247e5b19a2bd8ffdeec98" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:08:47.467144 23507 leader_election.cc:341] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:47.467882 23507 leader_election.cc:302] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:47.469156 24393 raft_consensus.cc:2726] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:47.513756 24262 tablet_bootstrap.cc:492] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
W20260807 11:08:47.516429 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet fd7256acb2114935922b69da9bc94209 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd7256acb2114935922b69da9bc94209 already in progress: creating tablet
W20260807 11:08:47.517791 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 5cbe28c4d9bf47258c0f694e21e00b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5cbe28c4d9bf47258c0f694e21e00b21 already in progress: creating tablet
I20260807 11:08:47.465726 23951 leader_election.cc:302] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
W20260807 11:08:47.521054 23951 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 55471.4us
I20260807 11:08:47.522205 24361 raft_consensus.cc:3037] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:47.350793 24266 tablet_bootstrap.cc:654] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:47.543402 24261 tablet_bootstrap.cc:492] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:47.426651 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet b677f3eac3f14f848a621e5b21e2393e (table default.Table_a7ad854935ce4319920d4f9f81ee4b6f [id=592d4df712864a53b5b7595a18dca4c0]) successfully deleted
W20260807 11:08:47.547348 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 120702us
I20260807 11:08:47.549901 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_502a73b19d284570ab5df3ec19d05d57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:47.552258 24261 tablet_bootstrap.cc:654] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:47.555224 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_502a73b19d284570ab5df3ec19d05d57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.550559 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a536193b9fc2446c9cfad81487d26c97" } modify_external_catalogs: true
I20260807 11:08:47.551738 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_8522529a488848f3b03e73129ea0d266"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:47.559212 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a536193b9fc2446c9cfad81487d26c97" } modify_external_catalogs: true
W20260807 11:08:47.561563 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8522529a488848f3b03e73129ea0d266 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.514736 24262 ts_tablet_manager.cc:1397] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.625s user 0.026s sys 0.011s
I20260807 11:08:47.578984 24367 raft_consensus.cc:2781] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:47.579222 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_803bc54a6b204b0a94f88404144b0afa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:47.579825 24367 raft_consensus.cc:686] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
W20260807 11:08:47.582145 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_803bc54a6b204b0a94f88404144b0afa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.581203 24367 consensus_queue.cc:237] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.596617 24261 tablet_bootstrap.cc:492] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:47.597023 24261 ts_tablet_manager.cc:1397] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.054s user 0.010s sys 0.010s
I20260807 11:08:47.599253 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_64cd1665df804462ba5435d0610f528d" } new_table_name: "default.Table_32fae9192e9849af9fe13a3eac8eaceb" modify_external_catalogs: true
I20260807 11:08:47.599160 24261 raft_consensus.cc:348] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.599783 24261 raft_consensus.cc:374] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.600037 24261 raft_consensus.cc:729] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:47.600603 24262 raft_consensus.cc:348] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.600674 24261 consensus_queue.cc:260] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.601423 24262 raft_consensus.cc:374] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.601715 24262 raft_consensus.cc:729] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:47.602342 24262 consensus_queue.cc:260] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.606204 24261 ts_tablet_manager.cc:1428] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260807 11:08:47.618502 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_48387cbb596e4ac4b05f65f85ae81561"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:47.622395 24261 tablet_bootstrap.cc:492] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:47.623798 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48387cbb596e4ac4b05f65f85ae81561 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:47.626605 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2049735828546ac9a996d26f6119127 consensus state has no leader
I20260807 11:08:47.627224 24261 tablet_bootstrap.cc:654] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:47.627426 23035 master_service.cc:946] ReplaceTablet: received request to replace tablet bd720024e90344a7a419a5293d742b22 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:47.628602 24262 ts_tablet_manager.cc:1428] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.043s user 0.004s sys 0.003s
I20260807 11:08:47.629905 24262 tablet_bootstrap.cc:492] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:47.632225 24361 raft_consensus.cc:2726] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:47.652861 24368 consensus_queue.cc:1035] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:47.666576 23037 master_service.cc:946] ReplaceTablet: received request to replace tablet 3430075bbedd48efbcd78cf6806623ac from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:47.691284 24266 tablet_bootstrap.cc:492] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:47.691887 24266 ts_tablet_manager.cc:1397] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.505s user 0.014s sys 0.001s
I20260807 11:08:47.694284 24266 raft_consensus.cc:348] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:47.714444 24261 tablet_bootstrap.cc:492] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:47.714871 24261 ts_tablet_manager.cc:1397] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.093s user 0.005s sys 0.009s
I20260807 11:08:47.717053 24261 raft_consensus.cc:348] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.717674 24261 raft_consensus.cc:374] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.717927 24261 raft_consensus.cc:729] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:47.724249 23041 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_79a7000df23c40f4b9b2ca741893f1f4 [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 1 got 0
W20260807 11:08:47.728211 23028 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cc7d0d889f2541a9a5c3c45f1c39df06 consensus state has no leader
I20260807 11:08:47.729282 23036 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541]). Expected version 1 got 0
I20260807 11:08:47.726287 24013 tablet_service.cc:1467] Processing CreateTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b (DEFAULT_TABLE table=default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.731454 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 555f31aac90945f8b8a53396a9dbbe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.738940 24266 raft_consensus.cc:374] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.739205 24266 raft_consensus.cc:729] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
W20260807 11:08:47.741755 23046 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.22.115.194:43979 (request call id 23) took 845 ms (client timeout 1000 ms). Trace:
I20260807 11:08:47.741766 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b (DEFAULT_TABLE table=default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.742823 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 555f31aac90945f8b8a53396a9dbbe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.744467 23816 tablet_service.cc:1514] Processing DeleteTablet for tablet b677f3eac3f14f848a621e5b21e2393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:47.744786 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet bd720024e90344a7a419a5293d742b22 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d7dd489496d45ca96d3cdac239e8713) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:47.745276 24247 tablet_replica.cc:330] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:47.745898 24247 raft_consensus.cc:2229] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:47.746521 24247 pending_rounds.cc:62] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Trying to abort 1 pending ops.
I20260807 11:08:47.746713 24247 pending_rounds.cc:68] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869399449735168 op_type: NO_OP noop_request { }
I20260807 11:08:47.747260 24247 raft_consensus.cc:2866] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:47.747609 24247 raft_consensus.cc:2258] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:47.749161 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet bd720024e90344a7a419a5293d742b22 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d7dd489496d45ca96d3cdac239e8713) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:47.745643 23041 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.22.115.195:51133 (request call id 19) took 826 ms (client timeout 1000 ms). Trace:
I20260807 11:08:47.749893 24250 tablet_replica.cc:330] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
W20260807 11:08:47.749850 23041 rpcz_store.cc:269] 0807 11:08:46.919441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:46.919607 (+ 166us) service_pool.cc:227] Handling call
0807 11:08:47.745582 (+825975us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260807 11:08:47.750566 24250 raft_consensus.cc:2229] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:47.750991 24250 raft_consensus.cc:2258] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:47.752504 24250 ts_tablet_manager.cc:1905] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:47.742095 23046 rpcz_store.cc:269] 0807 11:08:46.896804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:46.896973 (+ 169us) service_pool.cc:227] Handling call
0807 11:08:47.741695 (+844722us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:47.250601 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:47.250958 (+ 357us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:47.250981 (+ 23us) write_op.cc:435] Acquired schema lock
0807 11:08:47.251001 (+ 20us) tablet.cc:660] Decoding operations
0807 11:08:47.251246 (+ 245us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:47.251282 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:47.251311 (+ 29us) tablet.cc:683] Acquiring locks for 1 operations
0807 11:08:47.262127 (+ 10816us) tablet.cc:699] Row locks acquired
0807 11:08:47.262145 (+ 18us) write_op.cc:260] PREPARE: finished
0807 11:08:47.262249 (+ 104us) write_op.cc:270] Start()
0807 11:08:47.262340 (+ 91us) write_op.cc:276] Timestamp: P: 1786100927262187 usec, L: 0
0807 11:08:47.262357 (+ 17us) op_driver.cc:331] REPLICATION: starting
0807 11:08:47.262825 (+ 468us) log.cc:842] Serialized 535 byte log entry
0807 11:08:47.357565 (+ 94740us) op_driver.cc:444] REPLICATION: finished
0807 11:08:47.358421 (+ 856us) write_op.cc:301] APPLY: starting
0807 11:08:47.358471 (+ 50us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:47.358568 (+ 97us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:47.358650 (+ 82us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:47.358800 (+ 150us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:47.358947 (+ 147us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 11:08:47.358987 (+ 40us) write_op.cc:312] APPLY: finished
0807 11:08:47.359160 (+ 173us) log.cc:842] Serialized 22 byte log entry
0807 11:08:47.359302 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:47.359368 (+ 66us) write_op.cc:454] Released schema lock
0807 11:08:47.359399 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0807 11:08:47.359579 (+ 180us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:47.359610 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2856,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":677,"apply.run_cpu_time_us":1351,"apply.run_wall_time_us":1351,"num_ops":1,"prepare.queue_time_us":25070,"prepare.run_cpu_time_us":1914,"prepare.run_wall_time_us":20023,"raft.queue_time_us":1385,"raft.run_cpu_time_us":13,"raft.run_wall_time_us":13,"replication_time_us":95125}]]}
I20260807 11:08:47.754928 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.759029 24247 ts_tablet_manager.cc:1905] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:47.756397 23040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:47.763423 24021 tablet_service.cc:1514] Processing DeleteTablet for tablet e254839412ad42fcb6d2e22110d5ee24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:47.764758 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet e254839412ad42fcb6d2e22110d5ee24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e254839412ad42fcb6d2e22110d5ee24 already in progress: creating tablet
I20260807 11:08:47.765733 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet e254839412ad42fcb6d2e22110d5ee24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:47.767405 24266 consensus_queue.cc:260] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:47.758291 23041 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_790a627621de44e0a8f5aae06d786d3a [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 2 got 0
I20260807 11:08:47.774577 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet e254839412ad42fcb6d2e22110d5ee24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.778344 24021 tablet_service.cc:1467] Processing CreateTablet for tablet 069c0bb933ce4d29976205e0286071eb (DEFAULT_TABLE table=default.Table_a2648147880248d294c63834c8c7ca84 [id=6eac62be2b864055a748ec2e383186e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.784005 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet cdaf60bc130e4a84b7a309eec3109d61
I20260807 11:08:47.784657 23037 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 3430075bbedd48efbcd78cf6806623ac
I20260807 11:08:47.788036 23037 catalog_manager.cc:6565] ReplaceTablet: tablet 3430075bbedd48efbcd78cf6806623ac deleted and replaced by tablet 10f6d2989e09466aaa374575a11f40e3
I20260807 11:08:47.790655 24022 tablet_service.cc:1514] Processing DeleteTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:47.791689 24018 tablet_service.cc:1514] Processing DeleteTablet for tablet 3430075bbedd48efbcd78cf6806623ac with delete_type TABLET_DATA_DELETED (replaced by tablet 10f6d2989e09466aaa374575a11f40e3) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:47.794571 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 93a693730d9540049fda960d351425e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:47.796001 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.796785 23583 tablet_service.cc:1514] Processing DeleteTablet for tablet 3430075bbedd48efbcd78cf6806623ac with delete_type TABLET_DATA_DELETED (replaced by tablet 10f6d2989e09466aaa374575a11f40e3) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.798827 24252 tablet_replica.cc:330] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:47.801540 24252 raft_consensus.cc:2229] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:47.802264 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet cdaf60bc130e4a84b7a309eec3109d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdaf60bc130e4a84b7a309eec3109d61 already in progress: creating tablet
W20260807 11:08:47.802961 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 3430075bbedd48efbcd78cf6806623ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3430075bbedd48efbcd78cf6806623ac already in progress: creating tablet
I20260807 11:08:47.804751 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069c0bb933ce4d29976205e0286071eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:47.800877 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 77586.7us
I20260807 11:08:47.806289 23816 tablet_service.cc:1514] Processing DeleteTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:47.807972 23816 tablet_service.cc:1514] Processing DeleteTablet for tablet 3430075bbedd48efbcd78cf6806623ac with delete_type TABLET_DATA_DELETED (replaced by tablet 10f6d2989e09466aaa374575a11f40e3) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:47.809926 24262 tablet_bootstrap.cc:654] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:47.809540 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b (DEFAULT_TABLE table=default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.816776 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_20679d48620a4e42a043e92f81938d50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:47.820091 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20679d48620a4e42a043e92f81938d50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.821885 24435 consensus_queue.cc:1035] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 11:08:47.825730 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 555f31aac90945f8b8a53396a9dbbe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.840554 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a2648147880248d294c63834c8c7ca84" } new_table_name: "default.Table_93c716a578c941d3806babb08030b273" modify_external_catalogs: true
I20260807 11:08:47.851974 23037 catalog_manager.cc:5495] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } }
I20260807 11:08:47.820875 24261 consensus_queue.cc:260] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:47.874552 24266 ts_tablet_manager.cc:1428] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.182s user 0.006s sys 0.000s
I20260807 11:08:47.875519 24266 tablet_bootstrap.cc:492] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:47.897163 24252 raft_consensus.cc:2258] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:47.909747 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 2894fd38844b446f978022b8a1e5b2df with delete_type TABLET_DATA_DELETED (replaced by tablet e254839412ad42fcb6d2e22110d5ee24) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:47.913095 24252 ts_tablet_manager.cc:1905] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:47.898839 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_0e986c6a79d84a98b7351ebc3eac6415"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:47.946903 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e986c6a79d84a98b7351ebc3eac6415 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.900053 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6142de128f694ccfb31fcbde5ffd7d94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:47.952234 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6142de128f694ccfb31fcbde5ffd7d94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:47.955073 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4f45188e40aa49a2845642586546499c" } new_table_name: "default.Table_266b3f2db24e4a229fba35339d07b045" modify_external_catalogs: true
W20260807 11:08:47.918654 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 069c0bb933ce4d29976205e0286071eb consensus state has no leader
I20260807 11:08:47.947037 23037 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541]). Expected version 1 got 0
I20260807 11:08:47.966468 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 069c0bb933ce4d29976205e0286071eb (DEFAULT_TABLE table=default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.968559 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069c0bb933ce4d29976205e0286071eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.977463 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 with delete_type TABLET_DATA_DELETED (replaced by tablet 0071aac25afa4100b98c4811cf3e6b2e) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:47.980357 23572 tablet_service.cc:1467] Processing CreateTablet for tablet 655d379cab56486d872738de6acdffef (DEFAULT_TABLE table=default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.982208 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655d379cab56486d872738de6acdffef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.982638 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_20679d48620a4e42a043e92f81938d50" } modify_external_catalogs: true
I20260807 11:08:47.983547 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_20679d48620a4e42a043e92f81938d50" } modify_external_catalogs: true
I20260807 11:08:47.985301 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e (DEFAULT_TABLE table=default.Table_c8245140e191479a8dbca50ad401db93 [id=2353f55fa7e149748a100664634353bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.986693 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0071aac25afa4100b98c4811cf3e6b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.923875 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_346483ef4ac7421494c49985fdf86728"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:47.995932 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 655d379cab56486d872738de6acdffef (DEFAULT_TABLE table=default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:47.938016 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_790a627621de44e0a8f5aae06d786d3a [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 2 got 0
I20260807 11:08:47.997866 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655d379cab56486d872738de6acdffef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:47.996033 23041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_06348463068444bfa120534ced7a9e25" } modify_external_catalogs: true
I20260807 11:08:48.001120 23041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_06348463068444bfa120534ced7a9e25" } modify_external_catalogs: true
W20260807 11:08:48.009121 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dde5287f17a944708d7678c57bf37bf9 has no consensus state
I20260807 11:08:48.017396 24266 tablet_bootstrap.cc:654] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:48.017874 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_346483ef4ac7421494c49985fdf86728 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:48.024150 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e (DEFAULT_TABLE table=default.Table_c8245140e191479a8dbca50ad401db93 [id=2353f55fa7e149748a100664634353bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.025853 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0071aac25afa4100b98c4811cf3e6b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.032318 24262 tablet_bootstrap.cc:492] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:48.032725 24262 ts_tablet_manager.cc:1397] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.403s user 0.025s sys 0.025s
I20260807 11:08:48.031733 23813 tablet_service.cc:1467] Processing CreateTablet for tablet 069c0bb933ce4d29976205e0286071eb (DEFAULT_TABLE table=default.Table_a2648147880248d294c63834c8c7ca84 [id=6eac62be2b864055a748ec2e383186e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.036981 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e (DEFAULT_TABLE table=default.Table_c8245140e191479a8dbca50ad401db93 [id=2353f55fa7e149748a100664634353bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.038005 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 655d379cab56486d872738de6acdffef (DEFAULT_TABLE table=default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.042662 24262 raft_consensus.cc:348] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.043314 24262 raft_consensus.cc:374] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:47.963470 24247 ts_tablet_manager.cc:1918] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:48.043543 24262 raft_consensus.cc:729] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:48.043799 24247 log.cc:1196] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/b677f3eac3f14f848a621e5b21e2393e
I20260807 11:08:48.044095 24262 consensus_queue.cc:260] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.045600 24247 ts_tablet_manager.cc:1939] T b677f3eac3f14f848a621e5b21e2393e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:48.054886 23813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 069c0bb933ce4d29976205e0286071eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.059976 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0071aac25afa4100b98c4811cf3e6b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.065898 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6de3af683e604dc19feabffc5a34afb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:48.072578 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6de3af683e604dc19feabffc5a34afb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:48.074136 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 (DEFAULT_TABLE table=default.Table_06348463068444bfa120534ced7a9e25 [id=02196e29e7f34f2cb49d83c13053ca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.076427 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc42a1f14754b2fadd8eb5337b87057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.087051 23035 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0879b1578a0a4705b64b65ac875872b3
I20260807 11:08:48.092497 24261 ts_tablet_manager.cc:1428] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.377s user 0.011s sys 0.003s
I20260807 11:08:48.093401 24261 tablet_bootstrap.cc:492] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:48.105211 23041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 9fc42a1f14754b2fadd8eb5337b87057
I20260807 11:08:48.102068 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 (DEFAULT_TABLE table=default.Table_06348463068444bfa120534ced7a9e25 [id=02196e29e7f34f2cb49d83c13053ca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.109135 24250 ts_tablet_manager.cc:1918] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.109769 24012 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:48 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:48.073736 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 (DEFAULT_TABLE table=default.Table_06348463068444bfa120534ced7a9e25 [id=02196e29e7f34f2cb49d83c13053ca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.110570 24262 ts_tablet_manager.cc:1428] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.078s user 0.004s sys 0.004s
I20260807 11:08:48.109647 24250 log.cc:1196] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/bd720024e90344a7a419a5293d742b22
I20260807 11:08:48.106438 24019 tablet_service.cc:1467] Processing CreateTablet for tablet d5260c798aa645e5becf393f06528f87 (DEFAULT_TABLE table=default.Table_6fea2efc5c174bc18527ba33443d3a55 [id=630fa1b8352d4c6ca779091945333560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.111390 24250 ts_tablet_manager.cc:1939] T bd720024e90344a7a419a5293d742b22 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:48.116730 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc42a1f14754b2fadd8eb5337b87057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.123324 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5260c798aa645e5becf393f06528f87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:48.125590 23745 consensus_peers.cc:487] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:48.131994 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655d379cab56486d872738de6acdffef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.133399 23035 master_service.cc:946] ReplaceTablet: received request to replace tablet 40f0051d83e34bd2ae40986f45b0b8bd from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:48.137530 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet b677f3eac3f14f848a621e5b21e2393e (table default.Table_a7ad854935ce4319920d4f9f81ee4b6f [id=592d4df712864a53b5b7595a18dca4c0]) successfully deleted
W20260807 11:08:48.139482 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet bd720024e90344a7a419a5293d742b22 because the tablet was not found. No further retry: Not found: Tablet not found: bd720024e90344a7a419a5293d742b22
W20260807 11:08:48.140062 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet e254839412ad42fcb6d2e22110d5ee24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e254839412ad42fcb6d2e22110d5ee24 already in progress: creating tablet
W20260807 11:08:48.140609 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet cdaf60bc130e4a84b7a309eec3109d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdaf60bc130e4a84b7a309eec3109d61 already in progress: creating tablet
I20260807 11:08:48.142416 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc42a1f14754b2fadd8eb5337b87057. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:48.151844 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 3430075bbedd48efbcd78cf6806623ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3430075bbedd48efbcd78cf6806623ac already in progress: creating tablet
I20260807 11:08:48.168013 23048 master_service.cc:946] ReplaceTablet: received request to replace tablet c2049735828546ac9a996d26f6119127 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:48.167707 24262 tablet_bootstrap.cc:492] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:48.167954 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet b677f3eac3f14f848a621e5b21e2393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:48.173439 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet b677f3eac3f14f848a621e5b21e2393e because the tablet was not found. No further retry: Not found: Tablet not found: b677f3eac3f14f848a621e5b21e2393e
I20260807 11:08:48.181663 24252 ts_tablet_manager.cc:1918] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.182083 24252 log.cc:1196] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/93a693730d9540049fda960d351425e3
I20260807 11:08:48.183990 24252 ts_tablet_manager.cc:1939] T 93a693730d9540049fda960d351425e3 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:48.183988 23573 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:48 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:48.192034 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:48 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:48.194252 23816 tablet_service.cc:1467] Processing CreateTablet for tablet d5260c798aa645e5becf393f06528f87 (DEFAULT_TABLE table=default.Table_6fea2efc5c174bc18527ba33443d3a55 [id=630fa1b8352d4c6ca779091945333560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.196274 23816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5260c798aa645e5becf393f06528f87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:48.200321 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 9fc42a1f14754b2fadd8eb5337b87057 because the tablet was not found. No further retry: Not found: Tablet not found: 9fc42a1f14754b2fadd8eb5337b87057
I20260807 11:08:48.208850 23573 tablet_service.cc:1467] Processing CreateTablet for tablet d5260c798aa645e5becf393f06528f87 (DEFAULT_TABLE table=default.Table_6fea2efc5c174bc18527ba33443d3a55 [id=630fa1b8352d4c6ca779091945333560]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.210763 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5260c798aa645e5becf393f06528f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.217458 23818 tablet_service.cc:1467] Processing CreateTablet for tablet b102e85fa1714a29afbc8302be47921e (DEFAULT_TABLE table=default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.219014 23574 tablet_service.cc:1467] Processing CreateTablet for tablet b102e85fa1714a29afbc8302be47921e (DEFAULT_TABLE table=default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.219393 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b102e85fa1714a29afbc8302be47921e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.220242 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b102e85fa1714a29afbc8302be47921e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.235395 24252 tablet_replica.cc:330] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:48.236059 24252 raft_consensus.cc:2229] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:48.236470 24252 raft_consensus.cc:2258] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:48.237953 24252 ts_tablet_manager.cc:1905] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:48.255753 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 93a693730d9540049fda960d351425e3 (table default.Table_83665ed20c9240c790c6ebe6ca706e6f [id=7454612b977146668cdbbaab7a5baee7]) successfully deleted
I20260807 11:08:48.267642 24442 raft_consensus.cc:482] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:48.268172 24442 raft_consensus.cc:504] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.272710 24442 leader_election.cc:288] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:48.272710 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7d0d889f2541a9a5c3c45f1c39df06" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:48.273609 23841 raft_consensus.cc:2454] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:48.274808 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7d0d889f2541a9a5c3c45f1c39df06" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:48.275161 23507 leader_election.cc:302] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:08:48.276572 23510 leader_election.cc:341] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:48.276106 24442 raft_consensus.cc:2781] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:48.277624 24442 raft_consensus.cc:482] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:48.277376 24022 tablet_service.cc:1467] Processing CreateTablet for tablet b102e85fa1714a29afbc8302be47921e (DEFAULT_TABLE table=default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:48.278163 24442 raft_consensus.cc:3037] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:48.281147 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b102e85fa1714a29afbc8302be47921e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:48.287635 24252 ts_tablet_manager.cc:1918] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.288062 24252 log.cc:1196] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/2894fd38844b446f978022b8a1e5b2df
I20260807 11:08:48.288786 24252 ts_tablet_manager.cc:1939] T 2894fd38844b446f978022b8a1e5b2df P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:48.307538 23043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_48387cbb596e4ac4b05f65f85ae81561" } modify_external_catalogs: true
I20260807 11:08:48.307981 23046 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_502a73b19d284570ab5df3ec19d05d57" } new_table_name: "default.Table_00074ee5a1be4b9fbae6fb1643a94009" modify_external_catalogs: true
I20260807 11:08:48.308414 23043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_48387cbb596e4ac4b05f65f85ae81561" } modify_external_catalogs: true
I20260807 11:08:48.315665 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_caa47803b29d4efeb2c70fc09f48e17d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:48.306221 23036 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_8c7e5e4c285b42d7b553c1939691168d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:48.321914 23036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c7e5e4c285b42d7b553c1939691168d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:48.325920 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 2894fd38844b446f978022b8a1e5b2df (table default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4 [id=ff1332012e264831adffc1c10a065f50]) successfully deleted
W20260807 11:08:48.326557 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 9fc42a1f14754b2fadd8eb5337b87057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fc42a1f14754b2fadd8eb5337b87057 already in progress: creating tablet
I20260807 11:08:48.326952 24367 consensus_queue.cc:1035] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 11:08:48.344091 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_caa47803b29d4efeb2c70fc09f48e17d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:48.353112 24266 tablet_bootstrap.cc:492] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:48.353529 24266 ts_tablet_manager.cc:1397] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.478s user 0.021s sys 0.041s
I20260807 11:08:48.354182 24262 tablet_bootstrap.cc:654] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:48.367151 23041 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_790a627621de44e0a8f5aae06d786d3a [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 2 got 0
I20260807 11:08:48.371552 23805 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 with delete_type TABLET_DATA_DELETED (replaced by tablet 0071aac25afa4100b98c4811cf3e6b2e) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:48.372825 24247 tablet_replica.cc:330] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:48.372895 23042 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_32fae9192e9849af9fe13a3eac8eaceb" } new_table_name: "default.Table_bfdb65009c1f4abebd979f0ebc8d41d5" modify_external_catalogs: true
I20260807 11:08:48.373484 24247 raft_consensus.cc:2229] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:48.373901 24247 raft_consensus.cc:2258] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:48.375761 24247 ts_tablet_manager.cc:1905] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:48.386132 24262 tablet_bootstrap.cc:492] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:48.379684 24266 raft_consensus.cc:348] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.386533 24262 ts_tablet_manager.cc:1397] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.219s user 0.005s sys 0.010s
I20260807 11:08:48.386714 24266 raft_consensus.cc:374] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:48.386999 24266 raft_consensus.cc:729] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:48.387758 24266 consensus_queue.cc:260] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.396930 24266 ts_tablet_manager.cc:1428] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.043s user 0.008s sys 0.001s
I20260807 11:08:48.398767 24266 tablet_bootstrap.cc:492] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:48.397253 24262 raft_consensus.cc:348] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.400668 24262 raft_consensus.cc:374] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:48.400949 24262 raft_consensus.cc:729] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:48.401537 24262 consensus_queue.cc:260] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.405795 23041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_346483ef4ac7421494c49985fdf86728" } modify_external_catalogs: true
I20260807 11:08:48.410243 24262 ts_tablet_manager.cc:1428] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.023s user 0.001s sys 0.005s
I20260807 11:08:48.415493 24262 tablet_bootstrap.cc:492] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:48.441300 24262 tablet_bootstrap.cc:654] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:48.443238 24247 ts_tablet_manager.cc:1918] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.443665 24247 log.cc:1196] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/5cbe28c4d9bf47258c0f694e21e00b21
I20260807 11:08:48.444264 24247 ts_tablet_manager.cc:1939] T 5cbe28c4d9bf47258c0f694e21e00b21 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:48.446442 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 5cbe28c4d9bf47258c0f694e21e00b21 (table default.Table_c8245140e191479a8dbca50ad401db93 [id=2353f55fa7e149748a100664634353bb]) successfully deleted
I20260807 11:08:48.452217 24442 raft_consensus.cc:504] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.455442 24442 leader_election.cc:288] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:48.455718 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7d0d889f2541a9a5c3c45f1c39df06" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:48.464130 24262 tablet_bootstrap.cc:492] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:48.464501 24262 ts_tablet_manager.cc:1397] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.002s
I20260807 11:08:48.456451 23841 raft_consensus.cc:3037] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:48.480305 24262 raft_consensus.cc:348] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.481643 24262 raft_consensus.cc:374] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:48.481926 24262 raft_consensus.cc:729] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:48.482764 24262 consensus_queue.cc:260] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.406567 23041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_346483ef4ac7421494c49985fdf86728" } modify_external_catalogs: true
I20260807 11:08:48.495719 24262 ts_tablet_manager.cc:1428] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.031s user 0.010s sys 0.002s
I20260807 11:08:48.496675 24262 tablet_bootstrap.cc:492] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:48.514511 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7d0d889f2541a9a5c3c45f1c39df06" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:48.518054 23510 leader_election.cc:341] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:48.521044 24442 raft_consensus.cc:482] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:48.521772 24442 raft_consensus.cc:504] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.529146 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cbe28c4d9bf47258c0f694e21e00b21" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:48.531148 23510 leader_election.cc:341] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:48.532074 24442 leader_election.cc:288] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:48.532959 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet bd720024e90344a7a419a5293d742b22 (table default.Table_3f74892e07884e348597c936e6c04465 [id=5319693d27304aa3bac2365055974a3e]) successfully deleted
I20260807 11:08:48.536201 24250 tablet_replica.cc:330] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:48.536911 24250 raft_consensus.cc:2229] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:48.537312 24250 raft_consensus.cc:2258] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:48.539081 24250 ts_tablet_manager.cc:1905] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:48.546662 24261 tablet_bootstrap.cc:654] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:48.505178 24449 tablet.cc:1722] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260807 11:08:48.580754 23841 raft_consensus.cc:2454] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:48.569682 24448 tablet.cc:1722] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260807 11:08:48.557350 23507 leader_election.cc:341] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5cbe28c4d9bf47258c0f694e21e00b21
I20260807 11:08:48.593560 23507 leader_election.cc:302] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
W20260807 11:08:48.596555 23027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260807 11:08:48.599924 23507 leader_election.cc:302] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:48.601751 24393 raft_consensus.cc:2726] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:48.602627 24393 raft_consensus.cc:2781] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:48.603322 24393 raft_consensus.cc:686] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:48.604689 24393 consensus_queue.cc:237] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.608601 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet bd720024e90344a7a419a5293d742b22 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d7dd489496d45ca96d3cdac239e8713) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:48.609711 24252 tablet_replica.cc:330] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:48.610374 24252 raft_consensus.cc:2229] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:48.610805 24252 raft_consensus.cc:2258] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:48.613766 24252 ts_tablet_manager.cc:1905] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:48.617861 23037 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_790a627621de44e0a8f5aae06d786d3a [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 2 got 0
I20260807 11:08:48.620716 24266 tablet_bootstrap.cc:654] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:48.620981 24452 tablet.cc:1722] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260807 11:08:48.599943 24250 ts_tablet_manager.cc:1918] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.623811 24250 log.cc:1196] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/17c3fdae8df247e5b19a2bd8ffdeec98
I20260807 11:08:48.624488 24250 ts_tablet_manager.cc:1939] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:48.627097 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 17c3fdae8df247e5b19a2bd8ffdeec98 (table default.Table_3c7ba7b38d804dce82d12b1709901e65 [id=741b1ed419a64bbe97e563dc541cb876]) successfully deleted
W20260807 11:08:48.633589 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet e254839412ad42fcb6d2e22110d5ee24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e254839412ad42fcb6d2e22110d5ee24 already in progress: creating tablet
W20260807 11:08:48.635205 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet cdaf60bc130e4a84b7a309eec3109d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdaf60bc130e4a84b7a309eec3109d61 already in progress: creating tablet
I20260807 11:08:48.636142 24262 tablet_bootstrap.cc:654] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:48.641844 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 3430075bbedd48efbcd78cf6806623ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3430075bbedd48efbcd78cf6806623ac already in progress: creating tablet
I20260807 11:08:48.643054 24442 raft_consensus.cc:482] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:48.646485 24250 tablet_replica.cc:330] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:48.647217 24250 raft_consensus.cc:2229] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:48.647645 24250 raft_consensus.cc:2258] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260807 11:08:48.648955 23027 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 52415.2us
I20260807 11:08:48.649288 24250 ts_tablet_manager.cc:1905] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:48.654551 24252 ts_tablet_manager.cc:1918] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.643723 24442 raft_consensus.cc:504] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.659919 24442 leader_election.cc:288] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:48.660785 24252 log.cc:1196] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/bd720024e90344a7a419a5293d742b22
I20260807 11:08:48.661123 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd7256acb2114935922b69da9bc94209" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:48.661500 24252 ts_tablet_manager.cc:1939] T bd720024e90344a7a419a5293d742b22 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:48.664551 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd7256acb2114935922b69da9bc94209" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:08:48.666254 23510 leader_election.cc:341] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:48.668744 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet bd720024e90344a7a419a5293d742b22 (table default.Table_3f74892e07884e348597c936e6c04465 [id=5319693d27304aa3bac2365055974a3e]) successfully deleted
I20260807 11:08:48.675130 23841 raft_consensus.cc:2454] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:48.677222 23507 leader_election.cc:302] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:48.679104 24442 raft_consensus.cc:2781] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:48.679658 24442 raft_consensus.cc:482] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:48.683068 24442 raft_consensus.cc:3037] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:48.700872 23040 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_790a627621de44e0a8f5aae06d786d3a [id=f78c550f25a449ef9d47d66dd609e908]). Expected version 2 got 0
I20260807 11:08:48.697938 24442 raft_consensus.cc:504] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.715353 24262 tablet_bootstrap.cc:492] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:48.715790 24262 ts_tablet_manager.cc:1397] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.219s user 0.006s sys 0.013s
I20260807 11:08:48.716442 24261 tablet_bootstrap.cc:492] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:48.716836 24261 ts_tablet_manager.cc:1397] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.624s user 0.006s sys 0.011s
I20260807 11:08:48.720300 24261 raft_consensus.cc:348] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.720801 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet fd7256acb2114935922b69da9bc94209 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:46 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:48.720984 24261 raft_consensus.cc:374] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:48.721205 24261 raft_consensus.cc:729] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:48.721040 24262 raft_consensus.cc:348] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.721457 24461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:08:48.721738 24262 raft_consensus.cc:374] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:48.721962 24262 raft_consensus.cc:729] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:48.722536 24262 consensus_queue.cc:260] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.724962 24262 ts_tablet_manager.cc:1428] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260807 11:08:48.722107 24461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:48.731732 24442 leader_election.cc:288] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:48.734684 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd7256acb2114935922b69da9bc94209" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:48.736181 23510 leader_election.cc:341] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:48.739104 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet bd720024e90344a7a419a5293d742b22 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d7dd489496d45ca96d3cdac239e8713) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:48.739135 24261 consensus_queue.cc:260] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:48.741520 23030 catalog_manager.cc:4808] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet bd720024e90344a7a419a5293d742b22 because the tablet was not found. No further retry: Not found: Tablet not found: bd720024e90344a7a419a5293d742b22
I20260807 11:08:48.741938 24261 ts_tablet_manager.cc:1428] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.025s user 0.006s sys 0.002s
I20260807 11:08:48.746352 24250 ts_tablet_manager.cc:1918] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.746217 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd7256acb2114935922b69da9bc94209" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:48.752982 24261 tablet_bootstrap.cc:492] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:48.752723 24393 raft_consensus.cc:482] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:48.753388 24393 raft_consensus.cc:504] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.756870 24393 leader_election.cc:288] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:48.758868 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2049735828546ac9a996d26f6119127" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:48.746683 24250 log.cc:1196] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/5cbe28c4d9bf47258c0f694e21e00b21
W20260807 11:08:48.760953 23510 leader_election.cc:341] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:48.761576 24250 ts_tablet_manager.cc:1939] T 5cbe28c4d9bf47258c0f694e21e00b21 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:48.763831 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 5cbe28c4d9bf47258c0f694e21e00b21 (table default.Table_c8245140e191479a8dbca50ad401db93 [id=2353f55fa7e149748a100664634353bb]) successfully deleted
I20260807 11:08:48.770329 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2049735828546ac9a996d26f6119127" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:48.771232 23844 raft_consensus.cc:2454] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:48.771466 24448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:56920 (request call id 48) took 1032 ms. Trace:
W20260807 11:08:48.783929 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 9fc42a1f14754b2fadd8eb5337b87057 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fc42a1f14754b2fadd8eb5337b87057 already in progress: creating tablet
I20260807 11:08:48.784166 24250 tablet_replica.cc:330] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:48.784833 24250 raft_consensus.cc:2229] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:48.785280 24250 raft_consensus.cc:2258] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:48.785933 23841 raft_consensus.cc:3037] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:48.788584 24266 tablet_bootstrap.cc:492] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:48.788965 23507 leader_election.cc:302] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:48.772066 24448 rpcz_store.cc:276] 0807 11:08:47.739483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:47.739636 (+ 153us) service_pool.cc:227] Handling call
0807 11:08:48.771325 (+1031689us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:48.207401 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0807 11:08:48.215645 (+ 8244us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0807 11:08:48.215768 (+ 123us) alter_schema_op.cc:65] Acquired schema lock
0807 11:08:48.215926 (+ 158us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0807 11:08:48.216191 (+ 265us) alter_schema_op.cc:126] START. Timestamp: 1786100928168982
0807 11:08:48.216305 (+ 114us) op_driver.cc:331] REPLICATION: starting
0807 11:08:48.256046 (+ 39741us) log.cc:842] Serialized 173 byte log entry
0807 11:08:48.330700 (+ 74654us) op_driver.cc:444] REPLICATION: finished
0807 11:08:48.568857 (+238157us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0807 11:08:48.638165 (+ 69308us) log.cc:842] Serialized 5 byte log entry
0807 11:08:48.749592 (+111427us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:48.751615 (+ 2023us) log.cc:842] Serialized 14 byte log entry
0807 11:08:48.770983 (+ 19368us) alter_schema_op.cc:71] Released schema lock
0807 11:08:48.771052 (+ 69us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":237682,"prepare.queue_time_us":465343,"prepare.run_cpu_time_us":3949,"prepare.run_wall_time_us":68576,"raft.queue_time_us":2930,"raft.run_cpu_time_us":2240,"raft.run_wall_time_us":4285,"replication_time_us":114240,"thread_start_us":470095,"threads_started":2}]]}
I20260807 11:08:48.798960 24266 ts_tablet_manager.cc:1397] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.401s user 0.008s sys 0.006s
I20260807 11:08:48.801069 24250 ts_tablet_manager.cc:1905] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:48.801201 23028 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cc7d0d889f2541a9a5c3c45f1c39df06 consensus state has no leader
I20260807 11:08:48.802507 24442 raft_consensus.cc:2781] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:48.803048 24442 raft_consensus.cc:482] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:48.803586 24442 raft_consensus.cc:3037] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:48.805611 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 40f0051d83e34bd2ae40986f45b0b8bd
I20260807 11:08:48.807976 23035 catalog_manager.cc:6565] ReplaceTablet: tablet 40f0051d83e34bd2ae40986f45b0b8bd deleted and replaced by tablet f4f3bad2ba5e4178b29f52cfb53259db
I20260807 11:08:48.809499 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet f4f3bad2ba5e4178b29f52cfb53259db) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:48.811534 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 40f0051d83e34bd2ae40986f45b0b8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f0051d83e34bd2ae40986f45b0b8bd already in progress: creating tablet
I20260807 11:08:48.813426 23808 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet f4f3bad2ba5e4178b29f52cfb53259db) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:48.815820 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 40f0051d83e34bd2ae40986f45b0b8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f0051d83e34bd2ae40986f45b0b8bd already in progress: creating tablet
I20260807 11:08:48.833655 24262 tablet_bootstrap.cc:492] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:48.844672 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_465ca808156842049f2134ae0e427b18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:48.847730 24461 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:48.852747 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 3 candidate_status { last_received { term: 2 index: 117 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:08:48.858091 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_465ca808156842049f2134ae0e427b18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:48.863328 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 74517.7us
I20260807 11:08:48.867511 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet f4f3bad2ba5e4178b29f52cfb53259db) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:48.868896 24261 tablet_bootstrap.cc:654] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:48.873003 24442 raft_consensus.cc:504] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.866730 24250 ts_tablet_manager.cc:1918] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:48.875156 24250 log.cc:1196] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/fd7256acb2114935922b69da9bc94209
I20260807 11:08:48.875773 24250 ts_tablet_manager.cc:1939] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:48.878005 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet fd7256acb2114935922b69da9bc94209 (table default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2]) successfully deleted
W20260807 11:08:48.878729 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 40f0051d83e34bd2ae40986f45b0b8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f0051d83e34bd2ae40986f45b0b8bd already in progress: creating tablet
I20260807 11:08:48.880007 24442 leader_election.cc:288] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:48.882244 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2049735828546ac9a996d26f6119127" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:48.884131 23808 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:48.885329 23816 tablet_service.cc:1514] Processing DeleteTablet for tablet fd7256acb2114935922b69da9bc94209 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:46 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:48.888365 23510 leader_election.cc:341] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:48.891479 24247 tablet_replica.cc:330] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:48.892553 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2049735828546ac9a996d26f6119127" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:48.893414 23844 raft_consensus.cc:3037] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:48.895815 24247 raft_consensus.cc:2229] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:48.896251 24247 raft_consensus.cc:2258] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:48.896137 23841 raft_consensus.cc:2454] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:48.898031 24247 ts_tablet_manager.cc:1905] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:48.897893 23507 leader_election.cc:302] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
W20260807 11:08:48.899066 23507 raft_consensus.cc:2670] T fd7256acb2114935922b69da9bc94209 P 8a668588fabb4a9eba107cd6020f1e93: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 11:08:48.948740 23040 catalog_manager.cc:5495] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } }
W20260807 11:08:48.960536 23046 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84c78502f0a5485c9ffe4434c14567e0 has no consensus state
I20260807 11:08:48.962267 23043 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 53e615bf3025486bbd754d7c3020cb72
I20260807 11:08:48.961390 23040 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541]). Expected version 1 got 0
I20260807 11:08:48.986769 24261 tablet_bootstrap.cc:492] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:48.991910 24266 raft_consensus.cc:348] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:48.992168 23048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet c2049735828546ac9a996d26f6119127
W20260807 11:08:48.984634 23141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:48.994374 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet c2049735828546ac9a996d26f6119127 with delete_type TABLET_DATA_DELETED (replaced by tablet d78ed82613064935919934df7124d707) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:48.999224 24250 tablet_replica.cc:330] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:48.999917 24250 raft_consensus.cc:2229] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:49.000355 24250 raft_consensus.cc:2258] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:49.000757 23048 catalog_manager.cc:6565] ReplaceTablet: tablet c2049735828546ac9a996d26f6119127 deleted and replaced by tablet d78ed82613064935919934df7124d707
I20260807 11:08:49.002525 24250 ts_tablet_manager.cc:1905] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:49.005685 24261 ts_tablet_manager.cc:1397] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.250s user 0.006s sys 0.017s
I20260807 11:08:49.005776 24262 tablet_bootstrap.cc:654] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:49.008209 23844 raft_consensus.cc:2454] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:49.003710 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet c2049735828546ac9a996d26f6119127 with delete_type TABLET_DATA_DELETED (replaced by tablet d78ed82613064935919934df7124d707) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:49.015853 24266 raft_consensus.cc:374] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.016129 24266 raft_consensus.cc:729] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
W20260807 11:08:49.017417 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet c2049735828546ac9a996d26f6119127 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2049735828546ac9a996d26f6119127 already in progress: creating tablet
I20260807 11:08:49.027997 24250 ts_tablet_manager.cc:1918] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:49.028388 24250 log.cc:1196] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/c2049735828546ac9a996d26f6119127
I20260807 11:08:49.039510 24250 ts_tablet_manager.cc:1939] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:49.040777 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet c2049735828546ac9a996d26f6119127 (table default.Table_32fae9192e9849af9fe13a3eac8eaceb [id=d5c79d7bd03641dda09bcd556f2f64bf]) successfully deleted
I20260807 11:08:49.040875 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_f5086f7400214c24a865b6fda8ca94ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:49.041685 24266 consensus_queue.cc:260] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.059566 23036 master_service.cc:946] ReplaceTablet: received request to replace tablet 555f31aac90945f8b8a53396a9dbbe4b from {username='slave'} at 127.0.0.1:53338
W20260807 11:08:49.060868 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5086f7400214c24a865b6fda8ca94ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:49.072286 24266 ts_tablet_manager.cc:1428] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.271s user 0.003s sys 0.004s
I20260807 11:08:49.073220 24266 tablet_bootstrap.cc:492] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:49.098537 24266 tablet_bootstrap.cc:654] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:49.105037 23507 leader_election.cc:302] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
W20260807 11:08:49.106084 23507 raft_consensus.cc:2670] T c2049735828546ac9a996d26f6119127 P 8a668588fabb4a9eba107cd6020f1e93: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 11:08:49.110311 23041 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 7f3e1f5ae29a41c1a09599b68f51308b
I20260807 11:08:49.107215 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet c2049735828546ac9a996d26f6119127 with delete_type TABLET_DATA_DELETED (replaced by tablet d78ed82613064935919934df7124d707) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:49.120589 23027 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 -> Peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Couldn't send request to peer b43b3e5203ee4ac3a23fa1902356994b. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 11:08:49.124022 24266 tablet_bootstrap.cc:492] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:49.124439 24266 ts_tablet_manager.cc:1397] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.008s
I20260807 11:08:49.102161 24261 raft_consensus.cc:348] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.125941 24261 raft_consensus.cc:374] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.126235 24261 raft_consensus.cc:729] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.127019 24261 consensus_queue.cc:260] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.133461 24262 tablet_bootstrap.cc:492] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:49.133878 24262 ts_tablet_manager.cc:1397] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.306s user 0.014s sys 0.005s
I20260807 11:08:49.137639 24262 raft_consensus.cc:348] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.138273 24262 raft_consensus.cc:374] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.141716 24262 raft_consensus.cc:729] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.142406 24262 consensus_queue.cc:260] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.148185 24261 ts_tablet_manager.cc:1428] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.137s user 0.007s sys 0.000s
I20260807 11:08:49.158576 24247 ts_tablet_manager.cc:1918] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:49.158253 24266 raft_consensus.cc:348] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.159056 24247 log.cc:1196] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/17c3fdae8df247e5b19a2bd8ffdeec98
I20260807 11:08:49.159130 24266 raft_consensus.cc:374] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.159408 24266 raft_consensus.cc:729] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.159795 24247 ts_tablet_manager.cc:1939] T 17c3fdae8df247e5b19a2bd8ffdeec98 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:49.160410 24262 ts_tablet_manager.cc:1428] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.026s user 0.004s sys 0.004s
I20260807 11:08:49.162159 24247 tablet_replica.cc:330] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:49.163568 24266 consensus_queue.cc:260] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.175526 23043 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_c8245140e191479a8dbca50ad401db93" } new_table_name: "default.Table_980e69ceeabe4770af78e53803d0bf9a" modify_external_catalogs: true
I20260807 11:08:49.178689 23037 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_446937ecf2464c339f98882c9fe91d9f" } modify_external_catalogs: true
I20260807 11:08:49.179323 23037 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_446937ecf2464c339f98882c9fe91d9f" } modify_external_catalogs: true
W20260807 11:08:49.179095 23141 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 198111us
I20260807 11:08:49.162456 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 17c3fdae8df247e5b19a2bd8ffdeec98 (table default.Table_3c7ba7b38d804dce82d12b1709901e65 [id=741b1ed419a64bbe97e563dc541cb876]) successfully deleted
W20260807 11:08:49.183423 23141 leader_election.cc:334] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111)
I20260807 11:08:49.184347 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:49.185676 24461 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 11:08:49.149161 24261 tablet_bootstrap.cc:492] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:49.189652 24266 ts_tablet_manager.cc:1428] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.065s user 0.008s sys 0.000s
I20260807 11:08:49.197207 24266 tablet_bootstrap.cc:492] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:49.212724 24266 tablet_bootstrap.cc:654] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:49.163162 24262 tablet_bootstrap.cc:492] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:49.218255 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_063fa87be72f4638bf25ac62f327bc02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:49.221438 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_063fa87be72f4638bf25ac62f327bc02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:49.221915 23043 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0071aac25afa4100b98c4811cf3e6b2e consensus state has no leader
I20260807 11:08:49.228754 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_99f73061b4374e5684f0e76b71e37184"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:49.162829 24247 raft_consensus.cc:2229] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:49.232226 24247 raft_consensus.cc:2258] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:49.233865 24247 ts_tablet_manager.cc:1905] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:49.237018 24262 tablet_bootstrap.cc:654] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:49.237547 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99f73061b4374e5684f0e76b71e37184 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:49.261302 24261 tablet_bootstrap.cc:654] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:49.271536 23045 master_service.cc:946] ReplaceTablet: received request to replace tablet 655d379cab56486d872738de6acdffef from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:49.272986 24442 raft_consensus.cc:482] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:49.273772 24266 tablet_bootstrap.cc:492] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:49.273412 24442 raft_consensus.cc:504] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.274156 24266 ts_tablet_manager.cc:1397] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.014s
I20260807 11:08:49.275281 24442 leader_election.cc:288] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:49.277385 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f0051d83e34bd2ae40986f45b0b8bd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:49.279493 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f0051d83e34bd2ae40986f45b0b8bd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:49.280066 23844 raft_consensus.cc:2454] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
W20260807 11:08:49.287434 23510 leader_election.cc:341] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:49.289366 23507 leader_election.cc:302] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:49.291883 24442 raft_consensus.cc:2781] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:49.293955 24442 raft_consensus.cc:482] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:49.294616 24442 raft_consensus.cc:3037] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:49.295370 24266 raft_consensus.cc:348] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.298920 24266 raft_consensus.cc:374] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.299247 24266 raft_consensus.cc:729] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.300891 24266 consensus_queue.cc:260] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.307127 24266 ts_tablet_manager.cc:1428] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.033s user 0.008s sys 0.000s
I20260807 11:08:49.311080 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a (DEFAULT_TABLE table=default.Table_803bc54a6b204b0a94f88404144b0afa [id=426dfe43370d4e80b67e1365ba7bce51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.312006 24442 raft_consensus.cc:504] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.313154 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.313750 24266 tablet_bootstrap.cc:492] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:49.315129 23035 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: default.Table_790a627621de44e0a8f5aae06d786d3a [id=f78c550f25a449ef9d47d66dd609e908] alter complete (version 2)
I20260807 11:08:49.326694 24055 raft_consensus.cc:3037] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:49.331223 23042 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d78ed82613064935919934df7124d707 has no consensus state
I20260807 11:08:49.332237 23042 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:53338 (request call id 110) took 1105 ms. Trace:
I20260807 11:08:49.346979 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f0051d83e34bd2ae40986f45b0b8bd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:49.347877 23844 raft_consensus.cc:3037] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:49.347695 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a (DEFAULT_TABLE table=default.Table_803bc54a6b204b0a94f88404144b0afa [id=426dfe43370d4e80b67e1365ba7bce51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.349870 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.351856 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_86c6101a5d544b8a9d5dc3f9e22392d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:49.357396 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a (DEFAULT_TABLE table=default.Table_803bc54a6b204b0a94f88404144b0afa [id=426dfe43370d4e80b67e1365ba7bce51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.361256 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_980e69ceeabe4770af78e53803d0bf9a" } modify_external_catalogs: true
I20260807 11:08:49.362160 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_980e69ceeabe4770af78e53803d0bf9a" } modify_external_catalogs: true
I20260807 11:08:49.367552 23844 raft_consensus.cc:2454] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:49.369324 23507 leader_election.cc:302] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:49.376238 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40f0051d83e34bd2ae40986f45b0b8bd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:49.378319 23510 leader_election.cc:341] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:49.385641 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.392958 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet fd7256acb2114935922b69da9bc94209 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:46 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:49.393733 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_b224d6f750c84e61826a0ad2a3ce9bae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:49.395255 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet fd7256acb2114935922b69da9bc94209 because the tablet was not found. No further retry: Not found: Tablet not found: fd7256acb2114935922b69da9bc94209
I20260807 11:08:49.396229 24489 raft_consensus.cc:2781] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 11:08:49.397222 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b224d6f750c84e61826a0ad2a3ce9bae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:49.397696 24489 raft_consensus.cc:686] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:49.382166 24442 leader_election.cc:288] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:49.403393 23816 tablet_service.cc:1467] Processing CreateTablet for tablet 95fc220a912543eb8f43d6379795ca03 (DEFAULT_TABLE table=default.Table_6142de128f694ccfb31fcbde5ffd7d94 [id=df7d6690afb347e890c89bbb8cbd8875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.409298 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 6ce7963b93094c27b9e25308e68be630 (DEFAULT_TABLE table=default.Table_ea80ebfe1316466fbf771f6c3f93a72b [id=3ef9a19e237f46eabb5404d02b9ecee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.411911 24479 raft_consensus.cc:482] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:49.412596 24479 raft_consensus.cc:504] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.417913 24266 tablet_bootstrap.cc:654] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:49.417624 24479 leader_election.cc:288] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:49.423771 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 54621.3us
W20260807 11:08:49.428251 23954 leader_election.cc:341] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 5cbe28c4d9bf47258c0f694e21e00b21
I20260807 11:08:49.439513 24489 consensus_queue.cc:237] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:49.455588 23951 leader_election.cc:341] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5cbe28c4d9bf47258c0f694e21e00b21
I20260807 11:08:49.456533 23951 leader_election.cc:302] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:49.462159 24266 tablet_bootstrap.cc:492] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:49.462589 24266 ts_tablet_manager.cc:1397] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.149s user 0.010s sys 0.011s
I20260807 11:08:49.466178 24266 raft_consensus.cc:348] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.466838 24266 raft_consensus.cc:374] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.467352 24266 raft_consensus.cc:729] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.468088 24266 consensus_queue.cc:260] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.478091 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 95fc220a912543eb8f43d6379795ca03 (DEFAULT_TABLE table=default.Table_6142de128f694ccfb31fcbde5ffd7d94 [id=df7d6690afb347e890c89bbb8cbd8875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.481017 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 6ce7963b93094c27b9e25308e68be630 (DEFAULT_TABLE table=default.Table_ea80ebfe1316466fbf771f6c3f93a72b [id=3ef9a19e237f46eabb5404d02b9ecee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.482204 23816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95fc220a912543eb8f43d6379795ca03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.484361 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ce7963b93094c27b9e25308e68be630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.487340 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ce7963b93094c27b9e25308e68be630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.489104 24498 raft_consensus.cc:2726] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:49.490548 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95fc220a912543eb8f43d6379795ca03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.490262 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 95fc220a912543eb8f43d6379795ca03 (DEFAULT_TABLE table=default.Table_6142de128f694ccfb31fcbde5ffd7d94 [id=df7d6690afb347e890c89bbb8cbd8875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.491958 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95fc220a912543eb8f43d6379795ca03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.497010 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 6ce7963b93094c27b9e25308e68be630 (DEFAULT_TABLE table=default.Table_ea80ebfe1316466fbf771f6c3f93a72b [id=3ef9a19e237f46eabb5404d02b9ecee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.498911 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ce7963b93094c27b9e25308e68be630. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:49.432428 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86c6101a5d544b8a9d5dc3f9e22392d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:49.520493 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 5eaf45dad4a944dab77330db6fc53222 (DEFAULT_TABLE table=default.Table_17be8288b7444457b34389701b2f2ba7 [id=f7b5878fb01e49a5baf112e8b0a11e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.521164 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 5eaf45dad4a944dab77330db6fc53222 (DEFAULT_TABLE table=default.Table_17be8288b7444457b34389701b2f2ba7 [id=f7b5878fb01e49a5baf112e8b0a11e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.522549 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eaf45dad4a944dab77330db6fc53222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.523357 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eaf45dad4a944dab77330db6fc53222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.538655 24262 tablet_bootstrap.cc:492] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:49.539111 24262 ts_tablet_manager.cc:1397] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.376s user 0.009s sys 0.017s
I20260807 11:08:49.540225 23037 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 10f6d2989e09466aaa374575a11f40e3
I20260807 11:08:49.541704 23036 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 555f31aac90945f8b8a53396a9dbbe4b
I20260807 11:08:49.542928 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet f4f3bad2ba5e4178b29f52cfb53259db) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:49.549235 24262 raft_consensus.cc:348] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.551956 23036 catalog_manager.cc:6565] ReplaceTablet: tablet 555f31aac90945f8b8a53396a9dbbe4b deleted and replaced by tablet cc48c13644a3401ab34dad398a7f5cd5
I20260807 11:08:49.552462 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6d2989e09466aaa374575a11f40e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:49.549882 24262 raft_consensus.cc:374] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.553162 24262 raft_consensus.cc:729] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.554153 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b with delete_type TABLET_DATA_DELETED (replaced by tablet cc48c13644a3401ab34dad398a7f5cd5) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:49.555037 24262 consensus_queue.cc:260] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.557181 24262 ts_tablet_manager.cc:1428] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.018s user 0.002s sys 0.005s
I20260807 11:08:49.559598 23818 tablet_service.cc:1467] Processing CreateTablet for tablet dde5287f17a944708d7678c57bf37bf9 (DEFAULT_TABLE table=default.Table_266b3f2db24e4a229fba35339d07b045 [id=d8165adfe8ce4053b5b35900f89cd0de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.332881 23042 rpcz_store.cc:276] 0807 11:08:48.226481 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:48.226720 (+ 239us) service_pool.cc:227] Handling call
0807 11:08:48.372777 (+146057us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000217d4. stack: 00007fda4c4f7033 00007fda4c4f6f30 00007fda4c078534 00000000004db2b4 00000000004db249 00007fda53403af0 00007fda53486f2a 00007fda55352d6c 00007fda5544e7d6 00007fda52f94634 00007fda52f945c2 00007fda52f944f1 00007fda52f9446c 00007fda52f93722 00007fda5122d94c 00007fda5122cd86
0807 11:08:48.373676 (+ 899us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 11:08:48.375218 (+ 1542us) catalog_manager.cc:3616] Apply alter schema
0807 11:08:48.587254 (+212036us) catalog_manager.cc:3639] Acquired catalog manager lock
0807 11:08:48.587672 (+ 418us) catalog_manager.cc:3786] Updating metadata on disk
0807 11:08:49.108766 (+521094us) catalog_manager.cc:3817] Committing alterations to in-memory state
0807 11:08:49.332127 (+223361us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:48.590191 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:48.590563 (+ 372us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:48.590589 (+ 26us) write_op.cc:435] Acquired schema lock
0807 11:08:48.590603 (+ 14us) tablet.cc:660] Decoding operations
0807 11:08:48.590899 (+ 296us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:48.590935 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:48.590959 (+ 24us) tablet.cc:683] Acquiring locks for 1 operations
0807 11:08:48.591110 (+ 151us) tablet.cc:699] Row locks acquired
0807 11:08:48.591123 (+ 13us) write_op.cc:260] PREPARE: finished
0807 11:08:48.591242 (+ 119us) write_op.cc:270] Start()
0807 11:08:48.591328 (+ 86us) write_op.cc:276] Timestamp: P: 1786100928591185 usec, L: 0
0807 11:08:48.591344 (+ 16us) op_driver.cc:331] REPLICATION: starting
0807 11:08:48.591932 (+ 588us) log.cc:842] Serialized 404 byte log entry
0807 11:08:49.005847 (+413915us) op_driver.cc:444] REPLICATION: finished
0807 11:08:49.035037 (+ 29190us) write_op.cc:301] APPLY: starting
0807 11:08:49.035116 (+ 79us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:49.035302 (+ 186us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:49.035552 (+ 250us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:49.035795 (+ 243us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:49.035954 (+ 159us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 11:08:49.035998 (+ 44us) write_op.cc:312] APPLY: finished
0807 11:08:49.036253 (+ 255us) log.cc:842] Serialized 22 byte log entry
0807 11:08:49.104534 (+ 68281us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:49.105016 (+ 482us) write_op.cc:454] Released schema lock
0807 11:08:49.107053 (+ 2037us) write_op.cc:341] FINISH: Updating metrics
0807 11:08:49.109260 (+ 2207us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:49.109310 (+ 50us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":333251840,"child_traces":[["op",{"apply.queue_time_us":25442,"apply.run_cpu_time_us":2353,"apply.run_wall_time_us":79632,"num_ops":1,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":2014,"prepare.run_wall_time_us":2014,"replication_time_us":414427}]]}
I20260807 11:08:49.499173 23040 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_063fa87be72f4638bf25ac62f327bc02" } new_table_name: "default.Table_e8859f873e364b658e467328cee6a965" modify_external_catalogs: true
I20260807 11:08:49.573158 24266 ts_tablet_manager.cc:1428] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.110s user 0.017s sys 0.009s
I20260807 11:08:49.574162 24266 tablet_bootstrap.cc:492] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:49.574265 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6d2989e09466aaa374575a11f40e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:49.575382 24262 tablet_bootstrap.cc:492] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:49.577234 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b with delete_type TABLET_DATA_DELETED (replaced by tablet cc48c13644a3401ab34dad398a7f5cd5) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:49.588451 24266 tablet_bootstrap.cc:654] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:49.594372 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 10f6d2989e09466aaa374575a11f40e3 because the tablet was not found. No further retry: Not found: Tablet not found: 10f6d2989e09466aaa374575a11f40e3
I20260807 11:08:49.597957 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dde5287f17a944708d7678c57bf37bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.598708 24247 ts_tablet_manager.cc:1918] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:49.599265 24247 log.cc:1196] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/fd7256acb2114935922b69da9bc94209
I20260807 11:08:49.600044 24247 ts_tablet_manager.cc:1939] T fd7256acb2114935922b69da9bc94209 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
W20260807 11:08:49.605456 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 555f31aac90945f8b8a53396a9dbbe4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 555f31aac90945f8b8a53396a9dbbe4b already in progress: creating tablet
I20260807 11:08:49.583305 23813 tablet_service.cc:1467] Processing CreateTablet for tablet 84c78502f0a5485c9ffe4434c14567e0 (DEFAULT_TABLE table=default.Table_00074ee5a1be4b9fbae6fb1643a94009 [id=cc7e00d52d65403ea0b8dcbf0a438066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.610508 24247 tablet_replica.cc:330] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:49.611186 24247 raft_consensus.cc:2229] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:49.611589 24247 raft_consensus.cc:2258] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:49.613117 24247 ts_tablet_manager.cc:1905] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:49.619762 23572 tablet_service.cc:1467] Processing CreateTablet for tablet dde5287f17a944708d7678c57bf37bf9 (DEFAULT_TABLE table=default.Table_266b3f2db24e4a229fba35339d07b045 [id=d8165adfe8ce4053b5b35900f89cd0de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.622012 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dde5287f17a944708d7678c57bf37bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.622675 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 84c78502f0a5485c9ffe4434c14567e0 (DEFAULT_TABLE table=default.Table_00074ee5a1be4b9fbae6fb1643a94009 [id=cc7e00d52d65403ea0b8dcbf0a438066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.623714 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c78502f0a5485c9ffe4434c14567e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.629698 24261 tablet_bootstrap.cc:492] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:49.630115 24261 ts_tablet_manager.cc:1397] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.481s user 0.004s sys 0.015s
I20260807 11:08:49.631100 23045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 655d379cab56486d872738de6acdffef
I20260807 11:08:49.632436 23045 catalog_manager.cc:6565] ReplaceTablet: tablet 655d379cab56486d872738de6acdffef deleted and replaced by tablet 06a5e42d83ac4becb19a55d21040a3cc
I20260807 11:08:49.635627 23813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c78502f0a5485c9ffe4434c14567e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.636757 24261 raft_consensus.cc:348] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.637391 24261 raft_consensus.cc:374] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.637506 24262 tablet_bootstrap.cc:654] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:49.637636 24261 raft_consensus.cc:729] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.638156 24261 consensus_queue.cc:260] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.639951 23571 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2df15b35bd435baaf95a708ec85a37 (DEFAULT_TABLE table=default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.641062 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2df15b35bd435baaf95a708ec85a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.653805 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 10f6d2989e09466aaa374575a11f40e3 (DEFAULT_TABLE table=default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.654908 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f6d2989e09466aaa374575a11f40e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.661345 23802 tablet_service.cc:1514] Processing DeleteTablet for tablet 655d379cab56486d872738de6acdffef with delete_type TABLET_DATA_DELETED (replaced by tablet 06a5e42d83ac4becb19a55d21040a3cc) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:49.662024 23803 tablet_service.cc:1514] Processing DeleteTablet for tablet 3430075bbedd48efbcd78cf6806623ac with delete_type TABLET_DATA_DELETED (replaced by tablet 10f6d2989e09466aaa374575a11f40e3) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:49.663879 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet fd7256acb2114935922b69da9bc94209 (table default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2]) successfully deleted
I20260807 11:08:49.655975 23570 tablet_service.cc:1467] Processing CreateTablet for tablet 10f6d2989e09466aaa374575a11f40e3 (DEFAULT_TABLE table=default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:49.667634 24497 log.cc:924] Time spent T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Append to log took a long time: real 0.214s user 0.001s sys 0.002s
I20260807 11:08:49.676947 23566 tablet_service.cc:1514] Processing DeleteTablet for tablet 655d379cab56486d872738de6acdffef with delete_type TABLET_DATA_DELETED (replaced by tablet 06a5e42d83ac4becb19a55d21040a3cc) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:49.678360 23567 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet f4f3bad2ba5e4178b29f52cfb53259db) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:49.678876 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2df15b35bd435baaf95a708ec85a37 (DEFAULT_TABLE table=default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.681320 24250 tablet_replica.cc:330] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:49.681970 24250 raft_consensus.cc:2229] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:49.682597 24250 pending_rounds.cc:62] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Trying to abort 1 pending ops.
I20260807 11:08:49.682807 24250 pending_rounds.cc:68] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869407002804224 op_type: NO_OP noop_request { }
I20260807 11:08:49.683156 24250 raft_consensus.cc:2866] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:49.683463 24250 raft_consensus.cc:2258] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:49.680176 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2df15b35bd435baaf95a708ec85a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.687790 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:08:49.688376 24261 ts_tablet_manager.cc:1428] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.058s user 0.005s sys 0.001s
I20260807 11:08:49.689582 24003 tablet_service.cc:1514] Processing DeleteTablet for tablet 655d379cab56486d872738de6acdffef with delete_type TABLET_DATA_DELETED (replaced by tablet 06a5e42d83ac4becb19a55d21040a3cc) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:49.693498 24007 tablet_service.cc:1467] Processing CreateTablet for tablet 10f6d2989e09466aaa374575a11f40e3 (DEFAULT_TABLE table=default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:49.695626 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 655d379cab56486d872738de6acdffef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 655d379cab56486d872738de6acdffef already in progress: creating tablet
I20260807 11:08:49.695875 24008 tablet_service.cc:1467] Processing CreateTablet for tablet 738da1d000b4434cb194d91fea4cc6a5 (DEFAULT_TABLE table=default.Table_0e986c6a79d84a98b7351ebc3eac6415 [id=ba93341a8c3e469a93965e872dcf7686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.697415 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 738da1d000b4434cb194d91fea4cc6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.701061 24250 ts_tablet_manager.cc:1905] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:49.704015 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f6d2989e09466aaa374575a11f40e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.711678 23567 tablet_service.cc:1514] Processing DeleteTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:49.691102 23563 tablet_service.cc:1467] Processing CreateTablet for tablet 738da1d000b4434cb194d91fea4cc6a5 (DEFAULT_TABLE table=default.Table_0e986c6a79d84a98b7351ebc3eac6415 [id=ba93341a8c3e469a93965e872dcf7686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.681177 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_f78c4231b38c4549a6eccf4e590bf712"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:49.716446 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f78c4231b38c4549a6eccf4e590bf712 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:49.724895 23813 tablet_service.cc:1514] Processing DeleteTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:49.731882 23816 tablet_service.cc:1467] Processing CreateTablet for tablet 738da1d000b4434cb194d91fea4cc6a5 (DEFAULT_TABLE table=default.Table_0e986c6a79d84a98b7351ebc3eac6415 [id=ba93341a8c3e469a93965e872dcf7686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.733266 23816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 738da1d000b4434cb194d91fea4cc6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.744037 24262 tablet_bootstrap.cc:492] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:49.745652 24262 ts_tablet_manager.cc:1397] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.170s user 0.007s sys 0.010s
I20260807 11:08:49.738180 24247 ts_tablet_manager.cc:1918] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:49.748814 24247 log.cc:1196] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/c2049735828546ac9a996d26f6119127
I20260807 11:08:49.749404 24247 ts_tablet_manager.cc:1939] T c2049735828546ac9a996d26f6119127 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:49.756709 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 738da1d000b4434cb194d91fea4cc6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.760650 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_c3eea02a4e16494b954217bcdac2301b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:49.762063 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3eea02a4e16494b954217bcdac2301b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:49.762684 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet c2049735828546ac9a996d26f6119127 (table default.Table_bfdb65009c1f4abebd979f0ebc8d41d5 [id=d5c79d7bd03641dda09bcd556f2f64bf]) successfully deleted
I20260807 11:08:49.764395 24247 tablet_replica.cc:330] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:49.765023 24247 raft_consensus.cc:2229] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:49.765075 23040 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 02d17f09961641ca8c4d5a64f0fcadf8 has no consensus state
I20260807 11:08:49.765401 24247 raft_consensus.cc:2258] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:49.748347 24262 raft_consensus.cc:348] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:49.769749 24262 raft_consensus.cc:374] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:49.769819 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 3430075bbedd48efbcd78cf6806623ac with delete_type TABLET_DATA_DELETED (replaced by tablet 10f6d2989e09466aaa374575a11f40e3) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:49.770020 24262 raft_consensus.cc:729] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:49.777124 24262 consensus_queue.cc:260] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:49.793634 24247 ts_tablet_manager.cc:1905] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:49.797724 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_86c6101a5d544b8a9d5dc3f9e22392d6" } modify_external_catalogs: true
I20260807 11:08:49.788285 24262 ts_tablet_manager.cc:1428] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.042s user 0.005s sys 0.001s
I20260807 11:08:49.800699 24489 consensus_queue.cc:1035] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:49.800309 23040 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_790a627621de44e0a8f5aae06d786d3a" } new_table_name: "default.Table_94d25295c01640a9b6791586b00fe6bb" modify_external_catalogs: true
W20260807 11:08:49.821777 23029 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 02d17f09961641ca8c4d5a64f0fcadf8 has no consensus state
I20260807 11:08:49.826244 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_86c6101a5d544b8a9d5dc3f9e22392d6" } modify_external_catalogs: true
I20260807 11:08:49.811232 24261 tablet_bootstrap.cc:492] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:49.848241 24247 ts_tablet_manager.cc:1918] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:49.848762 24247 log.cc:1196] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/40f0051d83e34bd2ae40986f45b0b8bd
I20260807 11:08:49.849404 24247 ts_tablet_manager.cc:1939] T 40f0051d83e34bd2ae40986f45b0b8bd P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:49.877351 24002 tablet_service.cc:1514] Processing DeleteTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:49.883773 24021 tablet_service.cc:1514] Processing DeleteTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b with delete_type TABLET_DATA_DELETED (replaced by tablet cc48c13644a3401ab34dad398a7f5cd5) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:49.885383 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6d2989e09466aaa374575a11f40e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:49.905246 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6de3af683e604dc19feabffc5a34afb5" } modify_external_catalogs: true
I20260807 11:08:49.905800 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6de3af683e604dc19feabffc5a34afb5" } modify_external_catalogs: true
I20260807 11:08:49.907925 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_cc49327ea63d42fcaf5431611dfc5c09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:49.909613 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc49327ea63d42fcaf5431611dfc5c09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:49.910262 24499 raft_consensus.cc:482] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:49.924944 24012 tablet_service.cc:1467] Processing CreateTablet for tablet dde5287f17a944708d7678c57bf37bf9 (DEFAULT_TABLE table=default.Table_266b3f2db24e4a229fba35339d07b045 [id=d8165adfe8ce4053b5b35900f89cd0de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.897810 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f6d2989e09466aaa374575a11f40e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:49.943178 24009 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2df15b35bd435baaf95a708ec85a37 (DEFAULT_TABLE table=default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.944818 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 5eaf45dad4a944dab77330db6fc53222 (DEFAULT_TABLE table=default.Table_17be8288b7444457b34389701b2f2ba7 [id=f7b5878fb01e49a5baf112e8b0a11e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.954902 24266 tablet_bootstrap.cc:492] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:49.955874 24266 ts_tablet_manager.cc:1397] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.382s user 0.007s sys 0.015s
I20260807 11:08:49.973551 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_c50eac50bd2e4bf0a0d23e39fa4bdbf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:49.973574 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_266b3f2db24e4a229fba35339d07b045" } new_table_name: "default.Table_a46f408876e040f7abc059e728d04a9c" modify_external_catalogs: true
I20260807 11:08:49.911638 24499 raft_consensus.cc:504] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:49.979411 24011 tablet_service.cc:1467] Processing CreateTablet for tablet 84c78502f0a5485c9ffe4434c14567e0 (DEFAULT_TABLE table=default.Table_00074ee5a1be4b9fbae6fb1643a94009 [id=cc7e00d52d65403ea0b8dcbf0a438066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:49.994974 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_b226b03cf22c4dbf9a1be5ec1499a367"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:50.004411 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dde5287f17a944708d7678c57bf37bf9 consensus state has no leader
I20260807 11:08:50.009145 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet b677f3eac3f14f848a621e5b21e2393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:50.011114 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c50eac50bd2e4bf0a0d23e39fa4bdbf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:50.011600 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b226b03cf22c4dbf9a1be5ec1499a367 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:50.018395 24499 leader_election.cc:288] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:44.584894 24308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:44.595484 24232 server_base.cc:1034] running on GCE node
W20260807 11:08:44.617570 24303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:08:50.028781 24266 raft_consensus.cc:348] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:50.029515 24266 raft_consensus.cc:374] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:50.029812 24266 raft_consensus.cc:729] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:50.033180 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cbe28c4d9bf47258c0f694e21e00b21 with delete_type TABLET_DATA_DELETED (replaced by tablet 0071aac25afa4100b98c4811cf3e6b2e) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:50.044662 24012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dde5287f17a944708d7678c57bf37bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.049605 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2df15b35bd435baaf95a708ec85a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.050657 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eaf45dad4a944dab77330db6fc53222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.059319 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_34fa3c26a33e4270bb1ee80563113f7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:50.060835 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34fa3c26a33e4270bb1ee80563113f7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:50.075923 23041 master_service.cc:946] ReplaceTablet: received request to replace tablet 3430075bbedd48efbcd78cf6806623ac from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:50.030439 24266 consensus_queue.cc:260] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:50.095533 23035 master_service.cc:946] ReplaceTablet: received request to replace tablet 5eaf45dad4a944dab77330db6fc53222 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:50.095939 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c78502f0a5485c9ffe4434c14567e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.103499 24266 ts_tablet_manager.cc:1428] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.147s user 0.007s sys 0.003s
W20260807 11:08:50.107372 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 655d379cab56486d872738de6acdffef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 655d379cab56486d872738de6acdffef already in progress: creating tablet
W20260807 11:08:50.109086 23510 consensus_peers.cc:487] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:50.121788 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_71a5242b424247f7bd8bc0f937800b71" } new_table_name: "default.Table_c3485c1fbb944ca29c99d5da8d146c32" modify_external_catalogs: true
I20260807 11:08:50.137096 24506 tablet_replica.cc:330] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:50.138482 24266 tablet_bootstrap.cc:492] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:50.140372 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 64cb221021564d66bfecf5cd91bcec5c (DEFAULT_TABLE table=default.Table_86c6101a5d544b8a9d5dc3f9e22392d6 [id=f875636f9d7f422e8d85b33b269703ac]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:50.141896 22998 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 51105.2us
I20260807 11:08:50.146330 24232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:08:50.153317 23808 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd1107ba80a4dbeaba696a7b7095423 (DEFAULT_TABLE table=default.Table_f5086f7400214c24a865b6fda8ca94ab [id=9e28a60150c04136b617507a6af99466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.153568 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 64cb221021564d66bfecf5cd91bcec5c (DEFAULT_TABLE table=default.Table_86c6101a5d544b8a9d5dc3f9e22392d6 [id=f875636f9d7f422e8d85b33b269703ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.154577 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64cb221021564d66bfecf5cd91bcec5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.155989 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 275ff54bfeae4fd3ad19e697a2b83e74 (DEFAULT_TABLE table=default.Table_465ca808156842049f2134ae0e427b18 [id=66030bb2da214a7eb7804631eeceface]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.160416 23813 tablet_service.cc:1467] Processing CreateTablet for tablet b0ee41a2c21548e7961b3884e8c7a4ff (DEFAULT_TABLE table=default.Table_8c7e5e4c285b42d7b553c1939691168d [id=e14499712b28410b8d9a1e8335b5da46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.162418 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_65a2da468b554ee9ae8823384bd90ec5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:50.165558 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65a2da468b554ee9ae8823384bd90ec5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:50.167025 24506 raft_consensus.cc:2229] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:50.167256 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 0071aac25afa4100b98c4811cf3e6b2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0071aac25afa4100b98c4811cf3e6b2e already in progress: creating tablet
W20260807 11:08:50.168023 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 555f31aac90945f8b8a53396a9dbbe4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 555f31aac90945f8b8a53396a9dbbe4b already in progress: creating tablet
I20260807 11:08:50.167928 24506 raft_consensus.cc:2258] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
W20260807 11:08:50.168756 23030 catalog_manager.cc:4808] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 10f6d2989e09466aaa374575a11f40e3 because the tablet was not found. No further retry: Not found: Tablet not found: 10f6d2989e09466aaa374575a11f40e3
I20260807 11:08:50.178272 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 275ff54bfeae4fd3ad19e697a2b83e74 (DEFAULT_TABLE table=default.Table_465ca808156842049f2134ae0e427b18 [id=66030bb2da214a7eb7804631eeceface]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.179808 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 275ff54bfeae4fd3ad19e697a2b83e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.123916 24261 tablet_bootstrap.cc:654] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:50.126726 24250 ts_tablet_manager.cc:1918] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:50.184417 24250 log.cc:1196] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/40f0051d83e34bd2ae40986f45b0b8bd
I20260807 11:08:50.185117 24250 ts_tablet_manager.cc:1939] T 40f0051d83e34bd2ae40986f45b0b8bd P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:50.190196 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 17c3fdae8df247e5b19a2bd8ffdeec98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:45 UTC) from {username='slave'} at 127.0.0.1:40310
W20260807 11:08:50.193737 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 130302us
I20260807 11:08:50.194168 24266 tablet_bootstrap.cc:654] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:50.195638 24506 ts_tablet_manager.cc:1905] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:50.208343 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce42b3bd73242418f510c5b83259238 (DEFAULT_TABLE table=default.Table_caa47803b29d4efeb2c70fc09f48e17d [id=a290d2f87a7845ea939664dd56e1b79e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.217023 24013 tablet_service.cc:1467] Processing CreateTablet for tablet b0ee41a2c21548e7961b3884e8c7a4ff (DEFAULT_TABLE table=default.Table_8c7e5e4c285b42d7b553c1939691168d [id=e14499712b28410b8d9a1e8335b5da46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.218787 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0ee41a2c21548e7961b3884e8c7a4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.219195 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_17be8288b7444457b34389701b2f2ba7" } new_table_name: "default.Table_b208a091449545bb889b7ffb49a42e09" modify_external_catalogs: true
W20260807 11:08:50.219533 24017 consensus_meta.cc:287] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Time spent flushing consensus metadata: real 0.522s user 0.002s sys 0.009s
I20260807 11:08:50.225729 24489 raft_consensus.cc:482] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:50.226218 24489 raft_consensus.cc:504] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:50.227821 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 64cb221021564d66bfecf5cd91bcec5c (DEFAULT_TABLE table=default.Table_86c6101a5d544b8a9d5dc3f9e22392d6 [id=f875636f9d7f422e8d85b33b269703ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.228211 24489 leader_election.cc:288] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:50.228965 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64cb221021564d66bfecf5cd91bcec5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.230651 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce42b3bd73242418f510c5b83259238 (DEFAULT_TABLE table=default.Table_caa47803b29d4efeb2c70fc09f48e17d [id=a290d2f87a7845ea939664dd56e1b79e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.231773 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce42b3bd73242418f510c5b83259238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.231576 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd1107ba80a4dbeaba696a7b7095423 (DEFAULT_TABLE table=default.Table_f5086f7400214c24a865b6fda8ca94ab [id=9e28a60150c04136b617507a6af99466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.232576 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd1107ba80a4dbeaba696a7b7095423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.233282 23583 tablet_service.cc:1467] Processing CreateTablet for tablet b0ee41a2c21548e7961b3884e8c7a4ff (DEFAULT_TABLE table=default.Table_8c7e5e4c285b42d7b553c1939691168d [id=e14499712b28410b8d9a1e8335b5da46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.234314 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0ee41a2c21548e7961b3884e8c7a4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.240417 23571 tablet_service.cc:1467] Processing CreateTablet for tablet 275ff54bfeae4fd3ad19e697a2b83e74 (DEFAULT_TABLE table=default.Table_465ca808156842049f2134ae0e427b18 [id=66030bb2da214a7eb7804631eeceface]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.247642 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 275ff54bfeae4fd3ad19e697a2b83e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.261960 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3430075bbedd48efbcd78cf6806623ac" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:50.269599 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3430075bbedd48efbcd78cf6806623ac" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:50.270277 23846 raft_consensus.cc:2454] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:50.271548 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64cb221021564d66bfecf5cd91bcec5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.275574 24262 tablet_bootstrap.cc:492] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:50.278333 24247 tablet_replica.cc:330] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:50.283290 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 275ff54bfeae4fd3ad19e697a2b83e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.287112 24247 raft_consensus.cc:2229] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:50.287544 24247 raft_consensus.cc:2258] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:50.287773 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce42b3bd73242418f510c5b83259238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.289270 24247 ts_tablet_manager.cc:1905] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:50.291337 23813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0ee41a2c21548e7961b3884e8c7a4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.292865 24007 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd1107ba80a4dbeaba696a7b7095423 (DEFAULT_TABLE table=default.Table_f5086f7400214c24a865b6fda8ca94ab [id=9e28a60150c04136b617507a6af99466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.295279 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd1107ba80a4dbeaba696a7b7095423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.297747 24506 ts_tablet_manager.cc:1918] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:50.298131 24506 log.cc:1196] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/b677f3eac3f14f848a621e5b21e2393e
I20260807 11:08:50.299078 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd1107ba80a4dbeaba696a7b7095423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.299386 23507 leader_election.cc:302] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:50.304937 24250 tablet_replica.cc:330] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:50.305270 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 40f0051d83e34bd2ae40986f45b0b8bd (table default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]) successfully deleted
W20260807 11:08:50.305892 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 10f6d2989e09466aaa374575a11f40e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10f6d2989e09466aaa374575a11f40e3 already in progress: creating tablet
W20260807 11:08:50.306425 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 555f31aac90945f8b8a53396a9dbbe4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 555f31aac90945f8b8a53396a9dbbe4b already in progress: creating tablet
W20260807 11:08:50.306990 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 655d379cab56486d872738de6acdffef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 655d379cab56486d872738de6acdffef already in progress: creating tablet
I20260807 11:08:50.307503 24250 raft_consensus.cc:2229] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:50.307911 24250 raft_consensus.cc:2258] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:50.309499 24250 ts_tablet_manager.cc:1905] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:50.309729 24506 ts_tablet_manager.cc:1939] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:50.311302 24506 tablet_replica.cc:330] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:50.312003 24506 raft_consensus.cc:2229] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:50.312469 24506 raft_consensus.cc:2258] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:50.313182 24262 tablet_bootstrap.cc:654] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:50.317973 23954 leader_election.cc:341] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: b677f3eac3f14f848a621e5b21e2393e
I20260807 11:08:50.325742 24247 ts_tablet_manager.cc:1918] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:50.330786 23816 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb920ddfaaa423387c98112b52fc2e7 (DEFAULT_TABLE table=default.Table_6de3af683e604dc19feabffc5a34afb5 [id=b0c6bede76844f87acd18ee9fd31efe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.335034 24247 log.cc:1196] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/3430075bbedd48efbcd78cf6806623ac
I20260807 11:08:50.335613 23816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb920ddfaaa423387c98112b52fc2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.335716 24247 ts_tablet_manager.cc:1939] T 3430075bbedd48efbcd78cf6806623ac P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:50.333115 23802 tablet_service.cc:1467] Processing CreateTablet for tablet f4f3bad2ba5e4178b29f52cfb53259db (DEFAULT_TABLE table=default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.339233 24506 ts_tablet_manager.cc:1905] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:50.339570 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f3bad2ba5e4178b29f52cfb53259db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.343070 24232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:08:50.346021 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 3430075bbedd48efbcd78cf6806623ac (table default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]) successfully deleted
W20260807 11:08:50.346802 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 0071aac25afa4100b98c4811cf3e6b2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0071aac25afa4100b98c4811cf3e6b2e already in progress: creating tablet
W20260807 11:08:50.361723 23951 leader_election.cc:341] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: b677f3eac3f14f848a621e5b21e2393e
I20260807 11:08:50.362249 23951 leader_election.cc:302] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:50.364583 24232 hybrid_clock.cc:648] HybridClock initialized: now 1786100930364517 us; error 61 us; skew 500 ppm
I20260807 11:08:50.365747 24232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:08:50.385934 23046 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541]). Expected version 1 got 0
I20260807 11:08:50.391777 24506 ts_tablet_manager.cc:1918] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:50.392235 24506 log.cc:1196] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/5cbe28c4d9bf47258c0f694e21e00b21
I20260807 11:08:50.392958 24506 ts_tablet_manager.cc:1939] T 5cbe28c4d9bf47258c0f694e21e00b21 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:50.396129 24499 raft_consensus.cc:482] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:50.396890 24499 raft_consensus.cc:504] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:50.400415 24499 leader_election.cc:288] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:50.401276 23951 raft_consensus.cc:2670] T b677f3eac3f14f848a621e5b21e2393e P c281254655c84a0496c50045c37b22df: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 11:08:50.402912 24506 tablet_replica.cc:330] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:50.404237 24506 raft_consensus.cc:2229] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:50.404889 24506 raft_consensus.cc:2258] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:50.408936 23799 tablet_service.cc:1467] Processing CreateTablet for tablet f36b812880814298990c9aee6999f113 (DEFAULT_TABLE table=default.Table_99f73061b4374e5684f0e76b71e37184 [id=9e5c4d1a3cc44af8a5067e542f7a4445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.411262 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f36b812880814298990c9aee6999f113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.420084 23798 tablet_service.cc:1467] Processing CreateTablet for tablet cc48c13644a3401ab34dad398a7f5cd5 (DEFAULT_TABLE table=default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.422199 23798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc48c13644a3401ab34dad398a7f5cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.433502 23797 tablet_service.cc:1467] Processing CreateTablet for tablet 06a5e42d83ac4becb19a55d21040a3cc (DEFAULT_TABLE table=default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.435631 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06a5e42d83ac4becb19a55d21040a3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.441427 24261 tablet_bootstrap.cc:492] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:50.441800 24261 ts_tablet_manager.cc:1397] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.631s user 0.014s sys 0.004s
I20260807 11:08:50.445160 23796 tablet_service.cc:1467] Processing CreateTablet for tablet d78ed82613064935919934df7124d707 (DEFAULT_TABLE table=default.Table_bfdb65009c1f4abebd979f0ebc8d41d5 [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.447639 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d78ed82613064935919934df7124d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.453831 23795 tablet_service.cc:1467] Processing CreateTablet for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (DEFAULT_TABLE table=default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.456085 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d17f09961641ca8c4d5a64f0fcadf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.459916 24261 raft_consensus.cc:348] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.460557 24261 raft_consensus.cc:374] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:50.460788 24261 raft_consensus.cc:729] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:50.461365 24261 consensus_queue.cc:260] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.468758 24266 tablet_bootstrap.cc:492] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:50.469197 24266 ts_tablet_manager.cc:1397] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.331s user 0.021s sys 0.025s
I20260807 11:08:50.472007 24262 tablet_bootstrap.cc:492] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:50.472393 24262 ts_tablet_manager.cc:1397] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.197s user 0.005s sys 0.004s
I20260807 11:08:50.472429 24266 raft_consensus.cc:348] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:50.473066 24266 raft_consensus.cc:374] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:50.473343 24266 raft_consensus.cc:729] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:50.473951 24266 consensus_queue.cc:260] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:50.484732 24262 raft_consensus.cc:348] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.485385 24262 raft_consensus.cc:374] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:50.485631 24262 raft_consensus.cc:729] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:50.486191 24262 consensus_queue.cc:260] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.497126 24506 ts_tablet_manager.cc:1905] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:50.499914 24262 ts_tablet_manager.cc:1428] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20260807 11:08:50.501299 24262 tablet_bootstrap.cc:492] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:50.518404 24266 ts_tablet_manager.cc:1428] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.049s user 0.006s sys 0.000s
I20260807 11:08:50.519430 24266 tablet_bootstrap.cc:492] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:50.522276 24261 ts_tablet_manager.cc:1428] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.080s user 0.006s sys 0.002s
I20260807 11:08:50.527243 24261 tablet_bootstrap.cc:492] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:50.533573 23572 tablet_service.cc:1467] Processing CreateTablet for tablet 06a5e42d83ac4becb19a55d21040a3cc (DEFAULT_TABLE table=default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.536062 23570 tablet_service.cc:1467] Processing CreateTablet for tablet d78ed82613064935919934df7124d707 (DEFAULT_TABLE table=default.Table_bfdb65009c1f4abebd979f0ebc8d41d5 [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.536650 23573 tablet_service.cc:1467] Processing CreateTablet for tablet cc48c13644a3401ab34dad398a7f5cd5 (DEFAULT_TABLE table=default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.538262 23563 tablet_service.cc:1467] Processing CreateTablet for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (DEFAULT_TABLE table=default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.538688 23574 tablet_service.cc:1467] Processing CreateTablet for tablet f36b812880814298990c9aee6999f113 (DEFAULT_TABLE table=default.Table_99f73061b4374e5684f0e76b71e37184 [id=9e5c4d1a3cc44af8a5067e542f7a4445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.540905 23583 tablet_service.cc:1467] Processing CreateTablet for tablet f4f3bad2ba5e4178b29f52cfb53259db (DEFAULT_TABLE table=default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.541603 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06a5e42d83ac4becb19a55d21040a3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.541926 24266 tablet_bootstrap.cc:654] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:50.545384 24250 ts_tablet_manager.cc:1918] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:50.545753 24250 log.cc:1196] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/3430075bbedd48efbcd78cf6806623ac
I20260807 11:08:50.546021 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d78ed82613064935919934df7124d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.546411 24250 ts_tablet_manager.cc:1939] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:50.549881 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d17f09961641ca8c4d5a64f0fcadf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.551586 24261 tablet_bootstrap.cc:654] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:50.555824 23951 leader_election.cc:341] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 17c3fdae8df247e5b19a2bd8ffdeec98
W20260807 11:08:50.556452 23951 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 49683us
I20260807 11:08:50.560174 24007 tablet_service.cc:1467] Processing CreateTablet for tablet 1ce42b3bd73242418f510c5b83259238 (DEFAULT_TABLE table=default.Table_caa47803b29d4efeb2c70fc09f48e17d [id=a290d2f87a7845ea939664dd56e1b79e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.563473 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc48c13644a3401ab34dad398a7f5cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.563740 24019 tablet_service.cc:1467] Processing CreateTablet for tablet d78ed82613064935919934df7124d707 (DEFAULT_TABLE table=default.Table_bfdb65009c1f4abebd979f0ebc8d41d5 [id=d5c79d7bd03641dda09bcd556f2f64bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.566146 24009 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb920ddfaaa423387c98112b52fc2e7 (DEFAULT_TABLE table=default.Table_6de3af683e604dc19feabffc5a34afb5 [id=b0c6bede76844f87acd18ee9fd31efe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.567521 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f3bad2ba5e4178b29f52cfb53259db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.568084 24012 tablet_service.cc:1467] Processing CreateTablet for tablet f4f3bad2ba5e4178b29f52cfb53259db (DEFAULT_TABLE table=default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.570324 24018 tablet_service.cc:1467] Processing CreateTablet for tablet f36b812880814298990c9aee6999f113 (DEFAULT_TABLE table=default.Table_99f73061b4374e5684f0e76b71e37184 [id=9e5c4d1a3cc44af8a5067e542f7a4445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.572880 24011 tablet_service.cc:1467] Processing CreateTablet for tablet cc48c13644a3401ab34dad398a7f5cd5 (DEFAULT_TABLE table=default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.575567 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (DEFAULT_TABLE table=default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.576483 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ce42b3bd73242418f510c5b83259238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.578114 24008 tablet_service.cc:1467] Processing CreateTablet for tablet 06a5e42d83ac4becb19a55d21040a3cc (DEFAULT_TABLE table=default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.590090 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 40f0051d83e34bd2ae40986f45b0b8bd (table default.Table_a70046e0e22b47878d24ab3c264af9cc [id=addf5853969f42d08ae3cceca32c0f40]) successfully deleted
W20260807 11:08:50.590970 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 0071aac25afa4100b98c4811cf3e6b2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0071aac25afa4100b98c4811cf3e6b2e already in progress: creating tablet
I20260807 11:08:50.593927 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet b677f3eac3f14f848a621e5b21e2393e (table default.Table_a7ad854935ce4319920d4f9f81ee4b6f [id=592d4df712864a53b5b7595a18dca4c0]) successfully deleted
I20260807 11:08:50.595232 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb920ddfaaa423387c98112b52fc2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.596722 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d78ed82613064935919934df7124d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.604820 23040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 5fb920ddfaaa423387c98112b52fc2e7
I20260807 11:08:50.608979 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f36b812880814298990c9aee6999f113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.616918 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d17f09961641ca8c4d5a64f0fcadf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.619830 24012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f3bad2ba5e4178b29f52cfb53259db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.631796 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06a5e42d83ac4becb19a55d21040a3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.632097 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb920ddfaaa423387c98112b52fc2e7 (DEFAULT_TABLE table=default.Table_6de3af683e604dc19feabffc5a34afb5 [id=b0c6bede76844f87acd18ee9fd31efe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:50.633783 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb920ddfaaa423387c98112b52fc2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.654812 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet fd7256acb2114935922b69da9bc94209 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:46 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:50.671226 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f36b812880814298990c9aee6999f113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:50.673147 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc48c13644a3401ab34dad398a7f5cd5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:50.677148 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 356135us
I20260807 11:08:50.594692 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 5cbe28c4d9bf47258c0f694e21e00b21 (table default.Table_980e69ceeabe4770af78e53803d0bf9a [id=2353f55fa7e149748a100664634353bb]) successfully deleted
I20260807 11:08:50.679870 24232 webserver.cc:460] Webserver started at http://127.22.115.252:46049/ using document root <none> and password file <none>
I20260807 11:08:50.681318 24232 fs_manager.cc:359] Metadata directory not provided
I20260807 11:08:50.681622 24232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260807 11:08:50.679280 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 84594.6us
W20260807 11:08:50.678213 23510 leader_election.cc:341] T 3430075bbedd48efbcd78cf6806623ac P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:50.688622 23818 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fb920ddfaaa423387c98112b52fc2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:50.690583 24509 raft_consensus.cc:482] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:50.695838 23045 master_service.cc:946] ReplaceTablet: received request to replace tablet 069c0bb933ce4d29976205e0286071eb from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:50.691325 24509 raft_consensus.cc:504] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:50.706142 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 5fb920ddfaaa423387c98112b52fc2e7 because the tablet was not found. No further retry: Not found: Tablet not found: 5fb920ddfaaa423387c98112b52fc2e7
I20260807 11:08:50.706699 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fb920ddfaaa423387c98112b52fc2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:50.711592 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fb920ddfaaa423387c98112b52fc2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:50.714069 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 3430075bbedd48efbcd78cf6806623ac (table default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]) successfully deleted
I20260807 11:08:50.722329 24055 raft_consensus.cc:3037] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:50.727232 24262 tablet_bootstrap.cc:700] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent opening tablet: real 0.103s user 0.004s sys 0.004s
I20260807 11:08:50.727797 24262 tablet_bootstrap.cc:654] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:50.743336 23954 leader_election.cc:341] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 17c3fdae8df247e5b19a2bd8ffdeec98
I20260807 11:08:50.743997 23954 leader_election.cc:302] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
W20260807 11:08:50.745201 23954 raft_consensus.cc:2670] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 11:08:50.775758 24509 leader_election.cc:288] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:50.785831 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a2ef08f9524cb9bc89a7e4b9dcb5d2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:50.786806 23614 raft_consensus.cc:2454] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:50.788757 23745 leader_election.cc:302] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:50.789907 24509 raft_consensus.cc:2781] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:50.790411 24509 raft_consensus.cc:482] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:50.790782 24509 raft_consensus.cc:3037] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:50.806890 23036 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_ba00760e26b94608849fcc974443fbb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:50.808750 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_138bfe750aa94abf9acc8508267751d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:50.809643 23036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba00760e26b94608849fcc974443fbb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:50.810164 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_138bfe750aa94abf9acc8508267751d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:50.819845 24262 tablet_bootstrap.cc:492] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:50.820333 24262 ts_tablet_manager.cc:1397] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.319s user 0.014s sys 0.005s
I20260807 11:08:50.820904 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 5eaf45dad4a944dab77330db6fc53222
I20260807 11:08:50.823475 23035 catalog_manager.cc:6565] ReplaceTablet: tablet 5eaf45dad4a944dab77330db6fc53222 deleted and replaced by tablet 64c4a0700315457384e3ca995de8a4f2
W20260807 11:08:50.735965 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 5fb920ddfaaa423387c98112b52fc2e7 because the tablet was not found. No further retry: Not found: Tablet not found: 5fb920ddfaaa423387c98112b52fc2e7
W20260807 11:08:50.831657 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 95719.6us
I20260807 11:08:50.833482 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eaf45dad4a944dab77330db6fc53222 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4a0700315457384e3ca995de8a4f2) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:50.835191 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eaf45dad4a944dab77330db6fc53222 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4a0700315457384e3ca995de8a4f2) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:50.840183 24261 tablet_bootstrap.cc:492] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:50.840669 24261 ts_tablet_manager.cc:1397] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.314s user 0.012s sys 0.009s
W20260807 11:08:50.843098 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 5eaf45dad4a944dab77330db6fc53222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eaf45dad4a944dab77330db6fc53222 already in progress: creating tablet
I20260807 11:08:50.844204 24261 raft_consensus.cc:348] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.844914 24261 raft_consensus.cc:374] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:50.845173 24261 raft_consensus.cc:729] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:50.845818 24261 consensus_queue.cc:260] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:50.846253 23807 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s user 0.016s sys 0.009s
W20260807 11:08:50.846560 23807 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.578s user 0.016s sys 0.009s
I20260807 11:08:50.851802 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_57207993c2f443c6841b0228be8fe9b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:50.854790 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57207993c2f443c6841b0228be8fe9b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:50.860334 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 64cb221021564d66bfecf5cd91bcec5c
W20260807 11:08:50.860707 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 5eaf45dad4a944dab77330db6fc53222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eaf45dad4a944dab77330db6fc53222 already in progress: creating tablet
I20260807 11:08:50.861791 23042 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:53338 (request call id 128) took 1067 ms. Trace:
I20260807 11:08:50.870182 24261 ts_tablet_manager.cc:1428] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260807 11:08:50.862181 23042 rpcz_store.cc:276] 0807 11:08:49.793990 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:49.794428 (+ 438us) service_pool.cc:227] Handling call
0807 11:08:49.797562 (+ 3134us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b54000217d4. stack: 00007fda4c4f7033 00007fda4c4f6f30 00007fda4c078534 00000000004db2b4 00000000004db249 00007fda53403af0 00007fda53486f2a 00007fda55352d6c 00007fda5544e466 00007fda52f8fb34 00007fda52f8fac2 00007fda52f8f9f1 00007fda52f8f96c 00007fda52f8ec22 00007fda5122d94c 00007fda5122cd86
0807 11:08:49.846945 (+ 49383us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 11:08:49.864932 (+ 17987us) catalog_manager.cc:2752] Modifying in-memory table state
0807 11:08:49.865155 (+ 223us) catalog_manager.cc:2761] Locking tablets
0807 11:08:50.134997 (+269842us) catalog_manager.cc:2775] Removing table and tablets from system table
0807 11:08:50.859895 (+724898us) catalog_manager.cc:2793] Removing table from by-name map
0807 11:08:50.860128 (+ 233us) catalog_manager.cc:2809] Committing in-memory state
0807 11:08:50.860241 (+ 113us) catalog_manager.cc:2813] Aborting table tasks
0807 11:08:50.861734 (+ 1493us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:50.183794 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:50.184108 (+ 314us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:50.184129 (+ 21us) write_op.cc:435] Acquired schema lock
0807 11:08:50.184142 (+ 13us) tablet.cc:660] Decoding operations
0807 11:08:50.184735 (+ 593us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:50.184768 (+ 33us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:50.184789 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0807 11:08:50.185106 (+ 317us) tablet.cc:699] Row locks acquired
0807 11:08:50.185120 (+ 14us) write_op.cc:260] PREPARE: finished
0807 11:08:50.185216 (+ 96us) write_op.cc:270] Start()
0807 11:08:50.185349 (+ 133us) write_op.cc:276] Timestamp: P: 1786100930184572 usec, L: 0
0807 11:08:50.185368 (+ 19us) op_driver.cc:331] REPLICATION: starting
0807 11:08:50.185876 (+ 508us) log.cc:842] Serialized 734 byte log entry
0807 11:08:50.587317 (+401441us) op_driver.cc:444] REPLICATION: finished
0807 11:08:50.595001 (+ 7684us) write_op.cc:301] APPLY: starting
0807 11:08:50.595066 (+ 65us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:50.595230 (+ 164us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:50.595435 (+ 205us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:50.602717 (+ 7282us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5c0001ff0c. stack: 00007fda4c4f7033 00007fda4c4f6f30 00007fda4c078534 00000000004db2b4 00000000004db249 00000000004db0e1 00000000005314d1 00000000005c5a6c 00007fda537f691b 00007fda537f65e3 00007fda538f0b14 00007fda538dcdfa 00007fda538e0dd1 00007fda538e0d89 00007fda538e0d19 00007fda538e0ce1
0807 11:08:50.859078 (+256361us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:50.859220 (+ 142us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 11:08:50.859261 (+ 41us) write_op.cc:312] APPLY: finished
0807 11:08:50.859455 (+ 194us) log.cc:842] Serialized 29 byte log entry
0807 11:08:50.859615 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:50.859677 (+ 62us) write_op.cc:454] Released schema lock
0807 11:08:50.859706 (+ 29us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":4350336,"child_traces":[["op",{"apply.queue_time_us":3742,"mutex_wait_us":41362,"num_ops":2,"prepare.queue_time_us":46440,"prepare.run_cpu_time_us":1983,"prepare.run_wall_time_us":7345,"raft.queue_time_us":4958,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":14,"replication_time_us":401877,"spinlock_wait_cycles":4765440,"thread_start_us":218102,"threads_started":1}]]}
I20260807 11:08:50.877028 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet 64cb221021564d66bfecf5cd91bcec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:50.878743 24261 tablet_bootstrap.cc:492] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:50.880681 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 64cb221021564d66bfecf5cd91bcec5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64cb221021564d66bfecf5cd91bcec5c already in progress: creating tablet
I20260807 11:08:50.887187 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet 64cb221021564d66bfecf5cd91bcec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:50.888907 23844 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.621s user 0.008s sys 0.016s
W20260807 11:08:50.889284 23844 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.622s user 0.008s sys 0.016s
I20260807 11:08:50.892520 24262 raft_consensus.cc:348] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.892449 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a2ef08f9524cb9bc89a7e4b9dcb5d2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:50.893178 24262 raft_consensus.cc:374] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:50.893445 24262 raft_consensus.cc:729] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:50.904748 24261 tablet_bootstrap.cc:654] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:50.924821 24022 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eaf45dad4a944dab77330db6fc53222 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4a0700315457384e3ca995de8a4f2) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:50.925642 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 64cb221021564d66bfecf5cd91bcec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:50.933260 24261 tablet_bootstrap.cc:492] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:50.936955 24232 fs_manager.cc:709] Time spent opening directory manager: real 0.041s user 0.003s sys 0.007s
I20260807 11:08:50.941274 24261 ts_tablet_manager.cc:1397] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.011s
I20260807 11:08:50.894024 24262 consensus_queue.cc:260] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.953595 24261 raft_consensus.cc:348] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:50.955060 24261 raft_consensus.cc:374] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:50.961501 24261 raft_consensus.cc:729] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:50.961957 24538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:08:50.963109 24261 consensus_queue.cc:260] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:50.968693 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 64cb221021564d66bfecf5cd91bcec5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64cb221021564d66bfecf5cd91bcec5c already in progress: creating tablet
I20260807 11:08:50.973194 24232 fs_manager.cc:725] Time spent opening block manager: real 0.032s user 0.002s sys 0.006s
I20260807 11:08:50.973670 24232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
uuid: "b43b3e5203ee4ac3a23fa1902356994b"
format_stamp: "Formatted at 2026-08-07 11:08:30 on dist-test-slave-5bn2"
I20260807 11:08:50.979761 24232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:08:50.985697 24262 ts_tablet_manager.cc:1428] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.165s user 0.008s sys 0.000s
I20260807 11:08:50.986614 24262 tablet_bootstrap.cc:492] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:50.986377 24506 ts_tablet_manager.cc:1918] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:50.987722 24261 ts_tablet_manager.cc:1428] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.046s user 0.005s sys 0.004s
W20260807 11:08:50.962141 23745 leader_election.cc:341] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:50.985172 24509 raft_consensus.cc:504] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.006799 24509 leader_election.cc:288] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:51.007220 24261 tablet_bootstrap.cc:492] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:51.012351 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a2ef08f9524cb9bc89a7e4b9dcb5d2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:51.013216 23614 raft_consensus.cc:3037] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:51.026587 23614 raft_consensus.cc:2454] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:08:51.031270 24266 tablet_bootstrap.cc:492] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:51.030967 23745 leader_election.cc:302] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:51.033146 24509 raft_consensus.cc:2781] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:51.034251 24266 ts_tablet_manager.cc:1397] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.515s user 0.030s sys 0.032s
I20260807 11:08:51.034875 24509 raft_consensus.cc:686] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:08:51.036273 24509 consensus_queue.cc:237] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.049511 24262 tablet_bootstrap.cc:654] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.051102 24506 log.cc:1196] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/17c3fdae8df247e5b19a2bd8ffdeec98
I20260807 11:08:51.052541 24506 ts_tablet_manager.cc:1939] T 17c3fdae8df247e5b19a2bd8ffdeec98 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:51.055368 23844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.22.115.193:53803 (request call id 25) took 1251 ms. Trace:
I20260807 11:08:51.058571 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a2ef08f9524cb9bc89a7e4b9dcb5d2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:51.060024 23745 leader_election.cc:341] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.055737 23844 rpcz_store.cc:276] 0807 11:08:49.803925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:49.804113 (+ 188us) service_pool.cc:227] Handling call
0807 11:08:50.267138 (+463025us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 11:08:50.889748 (+622610us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 11:08:50.889786 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 11:08:50.890580 (+ 794us) log.cc:842] Serialized 26 byte log entry
0807 11:08:51.042348 (+151768us) raft_consensus.cc:1631] Marking committed up to 0
0807 11:08:51.042392 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 11:08:51.050941 (+ 8549us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 11:08:51.055063 (+ 4122us) raft_consensus.cc:1671] finished
0807 11:08:51.055089 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 11:08:51.055303 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":75163,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"thread_start_us":773173,"threads_started":2,"wal-append.queue_time_us":151612}
I20260807 11:08:51.093596 24489 raft_consensus.cc:482] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.094064 24489 raft_consensus.cc:504] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.096146 24261 tablet_bootstrap.cc:654] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.097004 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdaf60bc130e4a84b7a309eec3109d61" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:51.098135 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdaf60bc130e4a84b7a309eec3109d61" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:51.098779 24262 tablet_bootstrap.cc:492] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:51.099311 24262 ts_tablet_manager.cc:1397] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.113s user 0.006s sys 0.008s
W20260807 11:08:51.100399 23510 leader_election.cc:341] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:51.101081 23507 leader_election.cc:341] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.101483 23507 leader_election.cc:302] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:51.102667 24262 raft_consensus.cc:348] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.103345 24262 raft_consensus.cc:374] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.103598 24262 raft_consensus.cc:729] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.106359 24262 consensus_queue.cc:260] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.121088 24262 ts_tablet_manager.cc:1428] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260807 11:08:51.122460 24545 raft_consensus.cc:2726] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:51.103295 24489 leader_election.cc:288] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:51.134712 24262 tablet_bootstrap.cc:492] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:51.140602 24506 tablet_replica.cc:330] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:51.142058 24506 raft_consensus.cc:2229] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:51.156185 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b62eea967fed4adc84252b8366609878 consensus state has no leader
I20260807 11:08:51.156728 23041 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:53338 (request call id 137) took 1062 ms. Trace:
I20260807 11:08:51.158995 24261 tablet_bootstrap.cc:492] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:51.159405 24261 ts_tablet_manager.cc:1397] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.152s user 0.012s sys 0.004s
I20260807 11:08:51.159664 24368 raft_consensus.cc:482] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.160353 24368 raft_consensus.cc:504] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.163731 24368 leader_election.cc:288] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:08:51.168560 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 264051us
W20260807 11:08:51.173070 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64c4a0700315457384e3ca995de8a4f2 has no consensus state
W20260807 11:08:51.174095 23029 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 02d17f09961641ca8c4d5a64f0fcadf8 consensus state has no leader
I20260807 11:08:51.176055 24368 raft_consensus.cc:482] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.157022 23041 rpcz_store.cc:276] 0807 11:08:50.094793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:50.121272 (+ 26479us) service_pool.cc:227] Handling call
0807 11:08:50.122446 (+ 1174us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 11:08:50.123118 (+ 672us) catalog_manager.cc:3616] Apply alter schema
0807 11:08:50.123675 (+ 557us) catalog_manager.cc:3639] Acquired catalog manager lock
0807 11:08:50.123891 (+ 216us) catalog_manager.cc:3786] Updating metadata on disk
0807 11:08:51.155690 (+1031799us) catalog_manager.cc:3817] Committing alterations to in-memory state
0807 11:08:51.156672 (+ 982us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:50.355402 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:50.355711 (+ 309us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:50.355731 (+ 20us) write_op.cc:435] Acquired schema lock
0807 11:08:50.355743 (+ 12us) tablet.cc:660] Decoding operations
0807 11:08:50.355971 (+ 228us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:50.356003 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:50.356022 (+ 19us) tablet.cc:683] Acquiring locks for 1 operations
0807 11:08:50.356141 (+ 119us) tablet.cc:699] Row locks acquired
0807 11:08:50.356152 (+ 11us) write_op.cc:260] PREPARE: finished
0807 11:08:50.356245 (+ 93us) write_op.cc:270] Start()
0807 11:08:50.356315 (+ 70us) write_op.cc:276] Timestamp: P: 1786100930355588 usec, L: 0
0807 11:08:50.356331 (+ 16us) op_driver.cc:331] REPLICATION: starting
0807 11:08:50.356802 (+ 471us) log.cc:842] Serialized 405 byte log entry
0807 11:08:51.145826 (+789024us) op_driver.cc:444] REPLICATION: finished
0807 11:08:51.149033 (+ 3207us) write_op.cc:301] APPLY: starting
0807 11:08:51.150093 (+ 1060us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:51.151518 (+ 1425us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:51.151657 (+ 139us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:51.151901 (+ 244us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:51.152107 (+ 206us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 11:08:51.152205 (+ 98us) write_op.cc:312] APPLY: finished
0807 11:08:51.152491 (+ 286us) log.cc:842] Serialized 23 byte log entry
0807 11:08:51.152669 (+ 178us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:51.152805 (+ 136us) write_op.cc:454] Released schema lock
0807 11:08:51.152839 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0807 11:08:51.153048 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:51.153119 (+ 71us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":497,"apply.run_cpu_time_us":2158,"apply.run_wall_time_us":4263,"mutex_wait_us":230205,"num_ops":1,"prepare.queue_time_us":230409,"prepare.run_cpu_time_us":1636,"prepare.run_wall_time_us":1764,"raft.queue_time_us":75,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":11,"replication_time_us":789415}]]}
I20260807 11:08:51.176523 24368 raft_consensus.cc:504] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.178440 24262 tablet_bootstrap.cc:654] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.179409 24368 leader_election.cc:288] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:51.179363 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e254839412ad42fcb6d2e22110d5ee24" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:51.175585 24261 raft_consensus.cc:348] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.180548 24261 raft_consensus.cc:374] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.180807 24261 raft_consensus.cc:729] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.184965 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdaf60bc130e4a84b7a309eec3109d61" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:51.197645 23745 leader_election.cc:341] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.197991 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdaf60bc130e4a84b7a309eec3109d61" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:51.198558 23745 leader_election.cc:341] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.198984 23616 raft_consensus.cc:2454] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:51.203929 24261 consensus_queue.cc:260] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.221784 24261 ts_tablet_manager.cc:1428] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.062s user 0.007s sys 0.000s
I20260807 11:08:51.224174 23048 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541]). Expected version 1 got 0
I20260807 11:08:51.219202 23745 leader_election.cc:302] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:51.225240 24368 raft_consensus.cc:2781] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:51.225806 24368 raft_consensus.cc:482] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:51.189922 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 17c3fdae8df247e5b19a2bd8ffdeec98 (table default.Table_3c7ba7b38d804dce82d12b1709901e65 [id=741b1ed419a64bbe97e563dc541cb876]) successfully deleted
I20260807 11:08:51.226413 24368 raft_consensus.cc:3037] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:51.227679 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_65a2da468b554ee9ae8823384bd90ec5" } modify_external_catalogs: true
I20260807 11:08:51.228092 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6fea2efc5c174bc18527ba33443d3a55" } modify_external_catalogs: true
I20260807 11:08:51.228178 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_65a2da468b554ee9ae8823384bd90ec5" } modify_external_catalogs: true
I20260807 11:08:51.228700 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6fea2efc5c174bc18527ba33443d3a55" } modify_external_catalogs: true
I20260807 11:08:51.229185 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_fbc2eeb603af4b3a84797af4a00deb52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:51.230355 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:51.231063 24250 tablet_replica.cc:330] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:51.231758 24250 raft_consensus.cc:2229] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:51.232182 24250 raft_consensus.cc:2258] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:51.234546 24250 ts_tablet_manager.cc:1905] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:51.244918 24261 tablet_bootstrap.cc:492] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:51.251631 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbc2eeb603af4b3a84797af4a00deb52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:51.271720 24572 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260807 11:08:51.276067 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 47505.3us
I20260807 11:08:51.284974 23048 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541]). Expected version 1 got 0
I20260807 11:08:51.291987 24368 raft_consensus.cc:504] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.295712 23037 master_service.cc:946] ReplaceTablet: received request to replace tablet 42a046eb45bf4d619008ead6f6580713 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:51.300631 24262 tablet_bootstrap.cc:492] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:51.300724 24261 tablet_bootstrap.cc:654] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.301146 24262 ts_tablet_manager.cc:1397] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.179s user 0.008s sys 0.009s
I20260807 11:08:51.304476 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e254839412ad42fcb6d2e22110d5ee24" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:51.300316 24368 leader_election.cc:288] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:51.314271 24266 raft_consensus.cc:348] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:51.315126 24266 raft_consensus.cc:374] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.315440 24266 raft_consensus.cc:729] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.316344 24266 consensus_queue.cc:260] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:51.317117 24250 ts_tablet_manager.cc:1918] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:51.317476 24250 log.cc:1196] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/cdaf60bc130e4a84b7a309eec3109d61
I20260807 11:08:51.318090 24250 ts_tablet_manager.cc:1939] T cdaf60bc130e4a84b7a309eec3109d61 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:51.320116 24573 tablet.cc:1722] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260807 11:08:51.323159 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet cdaf60bc130e4a84b7a309eec3109d61 (table default.Table_a536193b9fc2446c9cfad81487d26c97 [id=32b96b2f0b644d94aa4ae5432d615506]) successfully deleted
I20260807 11:08:51.344798 23040 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet dcc664121f8c45fa968aaa67c12406e1
I20260807 11:08:51.365757 24553 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260807 11:08:51.375468 24261 tablet_bootstrap.cc:492] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:51.375860 24261 ts_tablet_manager.cc:1397] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.131s user 0.012s sys 0.010s
I20260807 11:08:51.362248 24574 tablet.cc:1722] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260807 11:08:51.369499 24554 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260807 11:08:51.142719 24506 raft_consensus.cc:2258] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:51.405673 24541 raft_consensus.cc:482] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.406417 24541 raft_consensus.cc:504] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.407052 24545 raft_consensus.cc:482] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.407584 24545 raft_consensus.cc:504] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.412086 24545 leader_election.cc:288] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:51.414821 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:08:51.415583 24499 raft_consensus.cc:659] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260807 11:08:51.415431 24541 leader_election.cc:288] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:51.378800 24261 raft_consensus.cc:348] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.416771 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e76082d4094493a544e18ce9594e20" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:51.417557 23846 raft_consensus.cc:2454] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:51.418213 24261 raft_consensus.cc:374] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.418465 24261 raft_consensus.cc:729] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.418817 23036 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_bd4ad9fadca04c0eaa62bf1d0f63e8cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:51.419534 23507 leader_election.cc:341] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.420624 24506 ts_tablet_manager.cc:1905] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:51.421301 23507 leader_election.cc:302] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:51.422806 24541 raft_consensus.cc:2781] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:51.423261 24541 raft_consensus.cc:482] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:51.423769 24541 raft_consensus.cc:3037] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:51.432755 24261 consensus_queue.cc:260] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.434268 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_803bc54a6b204b0a94f88404144b0afa" } new_table_name: "default.Table_e3b15a161c4540f3b477c59b4dafd867" modify_external_catalogs: true
I20260807 11:08:51.436115 24489 raft_consensus.cc:482] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.436591 24489 raft_consensus.cc:504] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.439095 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_325e5ccd9de34794b99618c7a22dd4c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:51.439882 24262 raft_consensus.cc:348] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.440265 24489 leader_election.cc:288] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:51.440541 24262 raft_consensus.cc:374] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.440770 24262 raft_consensus.cc:729] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
W20260807 11:08:51.443001 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 203406us
I20260807 11:08:51.447885 24261 ts_tablet_manager.cc:1428] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.072s user 0.007s sys 0.000s
I20260807 11:08:51.448220 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_99f73061b4374e5684f0e76b71e37184" } new_table_name: "default.Table_3e30bbe8a73348c2a9af2b1e51fbe2f5" modify_external_catalogs: true
I20260807 11:08:51.446679 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e254839412ad42fcb6d2e22110d5ee24" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:51.450676 23844 raft_consensus.cc:2454] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:51.452790 24261 tablet_bootstrap.cc:492] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:51.453677 23507 leader_election.cc:302] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:51.455540 24489 raft_consensus.cc:2781] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:51.456029 24489 raft_consensus.cc:482] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:51.456475 24489 raft_consensus.cc:3037] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:51.458324 24232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
W20260807 11:08:51.460652 23745 leader_election.cc:341] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.466614 23745 leader_election.cc:302] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:51.465971 24573 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:56920 (request call id 84) took 1578 ms. Trace:
I20260807 11:08:51.469345 24232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:08:51.469859 24368 raft_consensus.cc:2726] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:51.470481 24232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:08:51.471063 24262 consensus_queue.cc:260] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:51.471812 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ac76be04eca4d7d9d7f0cf6956fd56a consensus state has no leader
I20260807 11:08:51.475682 24262 ts_tablet_manager.cc:1428] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.174s user 0.007s sys 0.000s
W20260807 11:08:51.483305 23036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd4ad9fadca04c0eaa62bf1d0f63e8cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:51.497499 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_325e5ccd9de34794b99618c7a22dd4c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:51.505570 24572 tablet.cc:1722] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260807 11:08:51.495553 24262 tablet_bootstrap.cc:492] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:51.512509 23745 leader_election.cc:341] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: cdaf60bc130e4a84b7a309eec3109d61
I20260807 11:08:51.467787 24573 rpcz_store.cc:276] 0807 11:08:49.888224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:49.889213 (+ 989us) service_pool.cc:227] Handling call
0807 11:08:51.465902 (+1576689us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:50.811291 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0807 11:08:50.812199 (+ 908us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0807 11:08:50.812260 (+ 61us) alter_schema_op.cc:65] Acquired schema lock
0807 11:08:50.812365 (+ 105us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0807 11:08:50.812554 (+ 189us) alter_schema_op.cc:126] START. Timestamp: 1786100930812431
0807 11:08:50.812605 (+ 51us) op_driver.cc:331] REPLICATION: starting
0807 11:08:50.813516 (+ 911us) log.cc:842] Serialized 173 byte log entry
0807 11:08:51.114989 (+301473us) op_driver.cc:444] REPLICATION: finished
0807 11:08:51.319754 (+204765us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0807 11:08:51.322134 (+ 2380us) log.cc:842] Serialized 5 byte log entry
0807 11:08:51.401690 (+ 79556us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:51.403056 (+ 1366us) log.cc:842] Serialized 14 byte log entry
0807 11:08:51.465649 (+ 62593us) alter_schema_op.cc:71] Released schema lock
0807 11:08:51.465707 (+ 58us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":204562,"prepare.queue_time_us":537626,"prepare.run_cpu_time_us":11111,"prepare.run_wall_time_us":252056,"raft.queue_time_us":233,"raft.run_cpu_time_us":2449,"raft.run_wall_time_us":2449,"replication_time_us":302258,"thread_start_us":1079980,"threads_started":3,"wal-append.queue_time_us":230400}]]}
I20260807 11:08:51.530905 24261 tablet_bootstrap.cc:654] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.539690 24489 raft_consensus.cc:504] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.532033 24541 raft_consensus.cc:504] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.550946 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_e3b15a161c4540f3b477c59b4dafd867" } modify_external_catalogs: true
I20260807 11:08:51.551839 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_e3b15a161c4540f3b477c59b4dafd867" } modify_external_catalogs: true
I20260807 11:08:51.554423 24262 tablet_bootstrap.cc:654] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.554816 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_b691ab49ae6a48d4827f493634dc62e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:51.555665 24541 leader_election.cc:288] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:51.556437 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b691ab49ae6a48d4827f493634dc62e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:51.557171 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e76082d4094493a544e18ce9594e20" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:51.558005 23844 raft_consensus.cc:3037] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:51.558899 24489 leader_election.cc:288] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:51.564673 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e254839412ad42fcb6d2e22110d5ee24" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:51.565552 23846 raft_consensus.cc:3037] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:51.568517 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f36b812880814298990c9aee6999f113 consensus state has no leader
I20260807 11:08:51.578754 24266 ts_tablet_manager.cc:1428] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.544s user 0.010s sys 0.001s
W20260807 11:08:51.579222 24266 ts_tablet_manager.cc:1460] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Tablet startup took 544ms
I20260807 11:08:51.589732 23846 raft_consensus.cc:2454] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:51.591347 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e76082d4094493a544e18ce9594e20" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:51.595168 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e254839412ad42fcb6d2e22110d5ee24" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:51.599541 23510 leader_election.cc:341] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:51.581395 24266 ts_tablet_manager.cc:1462] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Trace:
0807 11:08:46.798930 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:46.800256 (+ 1326us) service_pool.cc:227] Handling call
0807 11:08:46.812257 (+ 12001us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 11:08:46.812384 (+ 127us) ts_tablet_manager.cc:676] Creating new metadata...
0807 11:08:46.851437 (+ 39053us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:46.863990 (+ 12553us) tablet_replica.cc:205] Creating consensus instance
0807 11:08:46.869972 (+ 5982us) inbound_call.cc:173] Queueing success response
0807 11:08:50.519146 (+3649174us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 11:08:51.034539 (+515393us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 11:08:51.076136 (+ 41597us) tablet_replica.cc:259] Starting instrumentation
0807 11:08:51.077148 (+ 1012us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":25337,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":321,"tablet-open.queue_time_us":3649309,"thread_start_us":10582,"threads_started":1}
I20260807 11:08:51.612104 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdaf60bc130e4a84b7a309eec3109d61" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:51.618597 24261 tablet_bootstrap.cc:492] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:51.619067 24261 ts_tablet_manager.cc:1397] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.166s user 0.008s sys 0.012s
I20260807 11:08:51.586477 23844 raft_consensus.cc:2454] T 88e76082d4094493a544e18ce9594e20 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:51.623989 23507 leader_election.cc:302] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:51.625883 23507 leader_election.cc:302] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:51.626286 24489 raft_consensus.cc:2781] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:51.626935 24489 raft_consensus.cc:686] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:51.628016 24489 consensus_queue.cc:237] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.631352 24541 raft_consensus.cc:2781] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:51.632151 24541 raft_consensus.cc:686] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:51.633436 24541 consensus_queue.cc:237] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.641412 23036 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_7c48f335b7db49d3ac516531dcda4561"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:51.622320 24261 raft_consensus.cc:348] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.650413 24261 raft_consensus.cc:374] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.650698 24261 raft_consensus.cc:729] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.651427 24261 consensus_queue.cc:260] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.654049 24261 ts_tablet_manager.cc:1428] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20260807 11:08:51.654896 24261 tablet_bootstrap.cc:492] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:51.665997 23745 leader_election.cc:341] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.664817 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e254839412ad42fcb6d2e22110d5ee24" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:51.666640 23745 leader_election.cc:302] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:51.667649 24368 raft_consensus.cc:2726] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 11:08:51.667791 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:51.669559 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e76082d4094493a544e18ce9594e20" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:51.674510 23036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c48f335b7db49d3ac516531dcda4561 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:51.677402 24266 tablet_bootstrap.cc:492] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:51.679672 23040 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_cc49327ea63d42fcaf5431611dfc5c09" } new_table_name: "default.Table_cf7d4147464e42238a2e055d3e1d9dc7" modify_external_catalogs: true
W20260807 11:08:51.680940 23510 leader_election.cc:341] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:51.682143 23510 leader_election.cc:341] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:51.683156 23510 leader_election.cc:341] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:51.683594 23027 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 99902.8us
I20260807 11:08:51.683527 23510 leader_election.cc:302] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:51.688927 24548 raft_consensus.cc:2726] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:08:51.692641 23510 leader_election.cc:341] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.708246 24266 tablet_bootstrap.cc:654] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.711334 24018 tablet_service.cc:1514] Processing DeleteTablet for tablet 3430075bbedd48efbcd78cf6806623ac with delete_type TABLET_DATA_DELETED (replaced by tablet 10f6d2989e09466aaa374575a11f40e3) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:51.755303 24262 tablet_bootstrap.cc:492] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:51.755717 24262 ts_tablet_manager.cc:1397] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.260s user 0.014s sys 0.018s
I20260807 11:08:51.755976 23043 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541]). Expected version 1 got 0
I20260807 11:08:51.761193 24261 tablet_bootstrap.cc:654] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.771941 24262 raft_consensus.cc:348] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.772650 24262 raft_consensus.cc:374] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.772894 24262 raft_consensus.cc:729] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.773541 24262 consensus_queue.cc:260] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.776777 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 2013df97d54d43aaa844154c200a5a4f (DEFAULT_TABLE table=default.Table_34fa3c26a33e4270bb1ee80563113f7e [id=c905367c134b46c9b29fa3837feae249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.778450 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2013df97d54d43aaa844154c200a5a4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:51.779407 23040 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc36c0c8fded4ac6991b98c132b17e56 consensus state has no leader
I20260807 11:08:51.780035 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 5f41042d50184ecf9bbd2c225c86aabf (DEFAULT_TABLE table=default.Table_b226b03cf22c4dbf9a1be5ec1499a367 [id=00a5f697df75490eaed389c034050304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.781805 23041 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
I20260807 11:08:51.785549 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_c3eea02a4e16494b954217bcdac2301b" } new_table_name: "default.Table_0e391a540a1f4eb09798376daa1dd533" modify_external_catalogs: true
I20260807 11:08:51.787791 24262 ts_tablet_manager.cc:1428] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.032s user 0.006s sys 0.002s
I20260807 11:08:51.788733 24262 tablet_bootstrap.cc:492] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:51.797580 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f41042d50184ecf9bbd2c225c86aabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.800294 23583 tablet_service.cc:1467] Processing CreateTablet for tablet cc36c0c8fded4ac6991b98c132b17e56 (DEFAULT_TABLE table=default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.801335 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc36c0c8fded4ac6991b98c132b17e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.802261 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_bcbbbb7ddd0840a7b45baef6133d5808"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:51.804039 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcbbbb7ddd0840a7b45baef6133d5808 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:51.812017 24266 tablet_bootstrap.cc:492] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:51.812440 24266 ts_tablet_manager.cc:1397] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.135s user 0.010s sys 0.002s
I20260807 11:08:51.812350 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 2013df97d54d43aaa844154c200a5a4f (DEFAULT_TABLE table=default.Table_34fa3c26a33e4270bb1ee80563113f7e [id=c905367c134b46c9b29fa3837feae249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.815640 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2013df97d54d43aaa844154c200a5a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.816128 24008 tablet_service.cc:1467] Processing CreateTablet for tablet cc36c0c8fded4ac6991b98c132b17e56 (DEFAULT_TABLE table=default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.817830 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc36c0c8fded4ac6991b98c132b17e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.821866 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 912026edd2664386880028a5958a993c (DEFAULT_TABLE table=default.Table_c3eea02a4e16494b954217bcdac2301b [id=01bc2a49d75f4d11bbbb6a644e2498b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.823328 24011 tablet_service.cc:1467] Processing CreateTablet for tablet 5f41042d50184ecf9bbd2c225c86aabf (DEFAULT_TABLE table=default.Table_b226b03cf22c4dbf9a1be5ec1499a367 [id=00a5f697df75490eaed389c034050304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.833868 24266 raft_consensus.cc:348] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:51.834724 24266 raft_consensus.cc:374] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.835103 24266 raft_consensus.cc:729] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.835909 24266 consensus_queue.cc:260] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:51.843422 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_776b2db76b154e8b8bc73b21a93265eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:51.844993 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_776b2db76b154e8b8bc73b21a93265eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:51.860435 24261 tablet_bootstrap.cc:492] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:51.860891 24261 ts_tablet_manager.cc:1397] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.206s user 0.004s sys 0.015s
I20260807 11:08:51.863972 24261 raft_consensus.cc:348] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.864630 24261 raft_consensus.cc:374] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.864630 23045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 069c0bb933ce4d29976205e0286071eb
I20260807 11:08:51.864869 24261 raft_consensus.cc:729] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.865542 24261 consensus_queue.cc:260] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.867964 24007 tablet_service.cc:1467] Processing CreateTablet for tablet 573b681662bc409aa36ccc65e14e9841 (DEFAULT_TABLE table=default.Table_b224d6f750c84e61826a0ad2a3ce9bae [id=5ffa653f0fab49eda6a08158a2a3c891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.868778 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 912026edd2664386880028a5958a993c (DEFAULT_TABLE table=default.Table_c3eea02a4e16494b954217bcdac2301b [id=01bc2a49d75f4d11bbbb6a644e2498b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.869781 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 912026edd2664386880028a5958a993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.871274 24262 tablet_bootstrap.cc:654] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.871130 23563 tablet_service.cc:1467] Processing CreateTablet for tablet 573b681662bc409aa36ccc65e14e9841 (DEFAULT_TABLE table=default.Table_b224d6f750c84e61826a0ad2a3ce9bae [id=5ffa653f0fab49eda6a08158a2a3c891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.875072 23045 catalog_manager.cc:6565] ReplaceTablet: tablet 069c0bb933ce4d29976205e0286071eb deleted and replaced by tablet fb1504be4320471687d86a55a9891081
I20260807 11:08:51.875610 23045 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:53338 (request call id 142) took 1183 ms. Trace:
I20260807 11:08:51.875802 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet 069c0bb933ce4d29976205e0286071eb with delete_type TABLET_DATA_DELETED (replaced by tablet fb1504be4320471687d86a55a9891081) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:51.877681 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573b681662bc409aa36ccc65e14e9841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.879241 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 069c0bb933ce4d29976205e0286071eb with delete_type TABLET_DATA_DELETED (replaced by tablet fb1504be4320471687d86a55a9891081) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:51.881384 24489 raft_consensus.cc:482] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.881992 24489 raft_consensus.cc:504] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.884788 24489 leader_election.cc:288] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:51.886703 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:51.888504 23510 leader_election.cc:341] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.889250 24261 ts_tablet_manager.cc:1428] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260807 11:08:51.890096 24261 tablet_bootstrap.cc:492] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:51.890841 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:51.891129 24368 raft_consensus.cc:482] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.892807 24368 raft_consensus.cc:504] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.895704 23844 raft_consensus.cc:2454] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:51.899577 23507 leader_election.cc:302] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:51.908028 24368 leader_election.cc:288] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:51.911278 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:51.910341 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:51.913251 23616 raft_consensus.cc:2454] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:51.915380 24489 raft_consensus.cc:2781] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:51.915712 24489 raft_consensus.cc:482] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:51.916072 24489 raft_consensus.cc:3037] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:51.876078 23045 rpcz_store.cc:276] 0807 11:08:50.691970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:50.695531 (+ 3561us) service_pool.cc:227] Handling call
0807 11:08:50.807199 (+111668us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000217d4. stack: 00007fda4c4f7033 00007fda4c4f6f30 00007fda4c078534 00000000004db2b4 00000000004db249 00007fda53403af0 00007fda53486f2a 00007fda55352d6c 00007fda55450b81 00007fda52fabd37 00007fda52fabcc2 00007fda52fabbf1 00007fda52fabb6c 00007fda52faae22 00007fda5122d94c 00007fda5122cd86
0807 11:08:51.875521 (+1068322us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:51.827051 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:51.827395 (+ 344us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:51.827419 (+ 24us) write_op.cc:435] Acquired schema lock
0807 11:08:51.827432 (+ 13us) tablet.cc:660] Decoding operations
0807 11:08:51.827787 (+ 355us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:51.827826 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:51.827848 (+ 22us) tablet.cc:683] Acquiring locks for 2 operations
0807 11:08:51.828034 (+ 186us) tablet.cc:699] Row locks acquired
0807 11:08:51.828047 (+ 13us) write_op.cc:260] PREPARE: finished
0807 11:08:51.828162 (+ 115us) write_op.cc:270] Start()
0807 11:08:51.828242 (+ 80us) write_op.cc:276] Timestamp: P: 1786100931825296 usec, L: 0
0807 11:08:51.828257 (+ 15us) op_driver.cc:331] REPLICATION: starting
0807 11:08:51.828750 (+ 493us) log.cc:842] Serialized 631 byte log entry
0807 11:08:51.860261 (+ 31511us) op_driver.cc:444] REPLICATION: finished
0807 11:08:51.860967 (+ 706us) write_op.cc:301] APPLY: starting
0807 11:08:51.861030 (+ 63us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:51.861257 (+ 227us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:51.861423 (+ 166us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:51.862181 (+ 758us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:51.862420 (+ 239us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 11:08:51.862480 (+ 60us) write_op.cc:312] APPLY: finished
0807 11:08:51.862759 (+ 279us) log.cc:842] Serialized 29 byte log entry
0807 11:08:51.863445 (+ 686us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:51.863558 (+ 113us) write_op.cc:454] Released schema lock
0807 11:08:51.863613 (+ 55us) write_op.cc:341] FINISH: Updating metrics
0807 11:08:51.863900 (+ 287us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:51.863961 (+ 61us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":253151616,"child_traces":[["op",{"apply.queue_time_us":445,"apply.run_cpu_time_us":2570,"apply.run_wall_time_us":3288,"num_ops":2,"prepare.queue_time_us":75602,"prepare.run_cpu_time_us":1977,"prepare.run_wall_time_us":3030,"raft.queue_time_us":969,"raft.run_cpu_time_us":1084,"raft.run_wall_time_us":1083,"replication_time_us":31932}]]}
I20260807 11:08:51.912638 23795 tablet_service.cc:1467] Processing CreateTablet for tablet 2013df97d54d43aaa844154c200a5a4f (DEFAULT_TABLE table=default.Table_34fa3c26a33e4270bb1ee80563113f7e [id=c905367c134b46c9b29fa3837feae249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.926261 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2013df97d54d43aaa844154c200a5a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.926275 23802 tablet_service.cc:1514] Processing DeleteTablet for tablet 069c0bb933ce4d29976205e0286071eb with delete_type TABLET_DATA_DELETED (replaced by tablet fb1504be4320471687d86a55a9891081) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:51.932273 24262 tablet_bootstrap.cc:492] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:51.932143 23796 tablet_service.cc:1467] Processing CreateTablet for tablet 912026edd2664386880028a5958a993c (DEFAULT_TABLE table=default.Table_c3eea02a4e16494b954217bcdac2301b [id=01bc2a49d75f4d11bbbb6a644e2498b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.932785 24262 ts_tablet_manager.cc:1397] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.144s user 0.003s sys 0.012s
I20260807 11:08:51.933534 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 912026edd2664386880028a5958a993c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:51.912897 23745 leader_election.cc:341] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:51.935526 23745 leader_election.cc:302] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:51.936401 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 912026edd2664386880028a5958a993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.937561 24368 raft_consensus.cc:2781] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:51.938063 24368 raft_consensus.cc:482] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:51.938124 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 573b681662bc409aa36ccc65e14e9841 (DEFAULT_TABLE table=default.Table_b224d6f750c84e61826a0ad2a3ce9bae [id=5ffa653f0fab49eda6a08158a2a3c891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.939711 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f41042d50184ecf9bbd2c225c86aabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.941653 24262 raft_consensus.cc:348] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.942384 24262 raft_consensus.cc:374] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:51.942682 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573b681662bc409aa36ccc65e14e9841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.920979 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet d5260c798aa645e5becf393f06528f87
I20260807 11:08:51.942932 23570 tablet_service.cc:1467] Processing CreateTablet for tablet cef5bc28dada49bdada085e87d1f0dab (DEFAULT_TABLE table=default.Table_c50eac50bd2e4bf0a0d23e39fa4bdbf3 [id=3a6709ec839444279264e56e47b6a0d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.924968 23799 tablet_service.cc:1467] Processing CreateTablet for tablet cc36c0c8fded4ac6991b98c132b17e56 (DEFAULT_TABLE table=default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.944659 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef5bc28dada49bdada085e87d1f0dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.945672 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc36c0c8fded4ac6991b98c132b17e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.948334 23809 tablet_service.cc:1514] Processing DeleteTablet for tablet d5260c798aa645e5becf393f06528f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:51.949079 24261 tablet_bootstrap.cc:654] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:51.935947 24013 tablet_service.cc:1467] Processing CreateTablet for tablet cef5bc28dada49bdada085e87d1f0dab (DEFAULT_TABLE table=default.Table_c50eac50bd2e4bf0a0d23e39fa4bdbf3 [id=3a6709ec839444279264e56e47b6a0d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.951520 24009 tablet_service.cc:1514] Processing DeleteTablet for tablet d5260c798aa645e5becf393f06528f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:51.951571 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573b681662bc409aa36ccc65e14e9841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.942807 24262 raft_consensus.cc:729] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:51.955332 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef5bc28dada49bdada085e87d1f0dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.955134 24262 consensus_queue.cc:260] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:51.955614 23573 tablet_service.cc:1514] Processing DeleteTablet for tablet d5260c798aa645e5becf393f06528f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:51.961072 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_2b2b746a82f74eb287a03155c60fae3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:51.962556 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b2b746a82f74eb287a03155c60fae3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:51.966188 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 069c0bb933ce4d29976205e0286071eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 069c0bb933ce4d29976205e0286071eb already in progress: creating tablet
W20260807 11:08:51.971434 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet d5260c798aa645e5becf393f06528f87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5260c798aa645e5becf393f06528f87 already in progress: creating tablet
I20260807 11:08:51.938656 24368 raft_consensus.cc:3037] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:51.940366 23807 tablet_service.cc:1467] Processing CreateTablet for tablet cef5bc28dada49bdada085e87d1f0dab (DEFAULT_TABLE table=default.Table_c50eac50bd2e4bf0a0d23e39fa4bdbf3 [id=3a6709ec839444279264e56e47b6a0d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.914985 23797 tablet_service.cc:1467] Processing CreateTablet for tablet 5f41042d50184ecf9bbd2c225c86aabf (DEFAULT_TABLE table=default.Table_b226b03cf22c4dbf9a1be5ec1499a367 [id=00a5f697df75490eaed389c034050304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:51.975867 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef5bc28dada49bdada085e87d1f0dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.980585 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f41042d50184ecf9bbd2c225c86aabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:51.984170 24577 raft_consensus.cc:482] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:51.984658 24577 raft_consensus.cc:504] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:51.985837 24262 ts_tablet_manager.cc:1428] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.053s user 0.006s sys 0.001s
I20260807 11:08:51.986755 24262 tablet_bootstrap.cc:492] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:51.986588 24577 leader_election.cc:288] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:52.003017 23951 leader_election.cc:341] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: c2049735828546ac9a996d26f6119127
I20260807 11:08:52.008594 24266 ts_tablet_manager.cc:1428] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.196s user 0.005s sys 0.003s
I20260807 11:08:52.037922 23036 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
I20260807 11:08:52.039122 23583 tablet_service.cc:1467] Processing CreateTablet for tablet cc365534189d493a9f3d28bbd4214544 (DEFAULT_TABLE table=default.Table_f78c4231b38c4549a6eccf4e590bf712 [id=c90dcf112c074f40a33e6049c331ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.039842 24261 tablet_bootstrap.cc:492] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:52.040234 24261 ts_tablet_manager.cc:1397] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.150s user 0.006s sys 0.011s
I20260807 11:08:52.040486 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc365534189d493a9f3d28bbd4214544. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:52.016314 23954 leader_election.cc:341] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: c2049735828546ac9a996d26f6119127
I20260807 11:08:52.043834 23954 leader_election.cc:302] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:52.039296 23036 catalog_manager.cc:5495] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:08:52.045225 24266 tablet_bootstrap.cc:492] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:52.018173 24577 raft_consensus.cc:482] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.019845 24009 tablet_service.cc:1467] Processing CreateTablet for tablet cc365534189d493a9f3d28bbd4214544 (DEFAULT_TABLE table=default.Table_f78c4231b38c4549a6eccf4e590bf712 [id=c90dcf112c074f40a33e6049c331ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.047868 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc365534189d493a9f3d28bbd4214544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.051192 24577 raft_consensus.cc:504] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:52.056458 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_c8e7c102b5df4cc6ac8958d6250ef4e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:52.056898 24577 leader_election.cc:288] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:52.059005 24577 raft_consensus.cc:2726] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:52.058573 23045 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_b224d6f750c84e61826a0ad2a3ce9bae" } new_table_name: "default.Table_dfc7836ffc654981bb422bfcb80486bc" modify_external_catalogs: true
W20260807 11:08:52.068446 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8e7c102b5df4cc6ac8958d6250ef4e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:52.070963 23954 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 54704.5us
W20260807 11:08:52.075757 23954 leader_election.cc:341] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 3430075bbedd48efbcd78cf6806623ac
I20260807 11:08:52.080065 24506 ts_tablet_manager.cc:1918] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:52.080597 24506 log.cc:1196] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/fd7256acb2114935922b69da9bc94209
I20260807 11:08:52.089378 24261 raft_consensus.cc:348] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.090131 24261 raft_consensus.cc:374] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 11:08:52.090042 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 069c0bb933ce4d29976205e0286071eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 069c0bb933ce4d29976205e0286071eb already in progress: creating tablet
I20260807 11:08:52.090355 24261 raft_consensus.cc:729] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
W20260807 11:08:52.090726 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet d5260c798aa645e5becf393f06528f87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5260c798aa645e5becf393f06528f87 already in progress: creating tablet
I20260807 11:08:52.091049 24261 consensus_queue.cc:260] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.102339 24489 raft_consensus.cc:504] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.104588 24262 tablet_bootstrap.cc:654] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.115279 23797 tablet_service.cc:1467] Processing CreateTablet for tablet cc365534189d493a9f3d28bbd4214544 (DEFAULT_TABLE table=default.Table_f78c4231b38c4549a6eccf4e590bf712 [id=c90dcf112c074f40a33e6049c331ff73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.117040 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc365534189d493a9f3d28bbd4214544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.104640 24368 raft_consensus.cc:504] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:52.130097 23951 leader_election.cc:341] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 3430075bbedd48efbcd78cf6806623ac
I20260807 11:08:52.131080 24368 leader_election.cc:288] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:52.130908 23951 leader_election.cc:302] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:52.132851 24604 raft_consensus.cc:2726] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:52.132315 23036 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
I20260807 11:08:52.133945 24506 ts_tablet_manager.cc:1939] T fd7256acb2114935922b69da9bc94209 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:52.145731 23037 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 42a046eb45bf4d619008ead6f6580713
I20260807 11:08:52.148428 23037 catalog_manager.cc:6565] ReplaceTablet: tablet 42a046eb45bf4d619008ead6f6580713 deleted and replaced by tablet 4b001bc080a14838a3fc58af982b792b
I20260807 11:08:52.162014 23802 tablet_service.cc:1514] Processing DeleteTablet for tablet 42a046eb45bf4d619008ead6f6580713 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b001bc080a14838a3fc58af982b792b) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.163255 24596 tablet_replica.cc:330] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:52.164660 24596 raft_consensus.cc:2229] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:52.166132 24596 raft_consensus.cc:2258] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:52.167320 24598 raft_consensus.cc:482] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.167732 24598 raft_consensus.cc:504] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.170274 24598 leader_election.cc:288] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:52.183037 24596 ts_tablet_manager.cc:1905] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:52.193574 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 912026edd2664386880028a5958a993c consensus state has no leader
I20260807 11:08:52.201761 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:52.203423 23510 leader_election.cc:341] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.206168 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:52.207031 23844 raft_consensus.cc:2379] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a668588fabb4a9eba107cd6020f1e93 in current term 1: Already voted for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in this term.
I20260807 11:08:52.207334 24262 tablet_bootstrap.cc:492] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:52.207696 24262 ts_tablet_manager.cc:1397] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.221s user 0.006s sys 0.012s
I20260807 11:08:52.208146 23507 leader_election.cc:302] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:52.209044 24541 raft_consensus.cc:2726] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 11:08:52.209348 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 2ac76be04eca4d7d9d7f0cf6956fd56a
I20260807 11:08:52.212005 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 93) took 1649 ms. Trace:
I20260807 11:08:52.213315 23573 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:52.217001 24489 leader_election.cc:288] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:52.219180 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 42a046eb45bf4d619008ead6f6580713 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b001bc080a14838a3fc58af982b792b) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:52.219908 24261 ts_tablet_manager.cc:1428] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.179s user 0.006s sys 0.002s
I20260807 11:08:52.219776 23048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_f78c4231b38c4549a6eccf4e590bf712" } modify_external_catalogs: true
I20260807 11:08:52.220275 23048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_f78c4231b38c4549a6eccf4e590bf712" } modify_external_catalogs: true
W20260807 11:08:52.220302 23027 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 912026edd2664386880028a5958a993c (table default.Table_0e391a540a1f4eb09798376daa1dd533 [id=01bc2a49d75f4d11bbbb6a644e2498b3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 912026edd2664386880028a5958a993c consensus state has no leader
I20260807 11:08:52.234102 24593 tablet_replica.cc:330] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
W20260807 11:08:52.234174 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ac76be04eca4d7d9d7f0cf6956fd56a already in progress: creating tablet
I20260807 11:08:52.235368 24593 raft_consensus.cc:2229] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:52.236197 24593 raft_consensus.cc:2258] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:52.244004 24261 tablet_bootstrap.cc:492] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:52.214429 24012 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.236182 24262 raft_consensus.cc:348] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.256922 24262 raft_consensus.cc:374] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:52.257195 24262 raft_consensus.cc:729] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:52.258693 24266 tablet_bootstrap.cc:654] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.252125 24018 tablet_service.cc:1514] Processing DeleteTablet for tablet 42a046eb45bf4d619008ead6f6580713 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b001bc080a14838a3fc58af982b792b) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.257926 24262 consensus_queue.cc:260] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.212333 24506 rpcz_store.cc:276] 0807 11:08:50.654354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:50.654572 (+ 218us) service_pool.cc:227] Handling call
0807 11:08:51.140364 (+485792us) ts_tablet_manager.cc:1145] Deleting tablet fd7256acb2114935922b69da9bc94209
0807 11:08:51.140420 (+ 56us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:51.706265 (+565845us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:52.079719 (+373454us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:52.211929 (+132210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":484949}
I20260807 11:08:52.296067 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet fd7256acb2114935922b69da9bc94209 (table default.Table_a7658071bcf140b7a98557dffc8a9289 [id=cfccac222fe14b44b42ee8f1ccac96a2]) successfully deleted
I20260807 11:08:52.297614 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 94) took 1586 ms. Trace:
I20260807 11:08:52.298202 24506 rpcz_store.cc:276] 0807 11:08:50.711000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:50.711236 (+ 236us) service_pool.cc:227] Handling call
0807 11:08:52.297107 (+1585871us) ts_tablet_manager.cc:1145] Deleting tablet 5fb920ddfaaa423387c98112b52fc2e7
0807 11:08:52.297173 (+ 66us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:52.297518 (+ 345us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1584831}
W20260807 11:08:52.299999 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 5fb920ddfaaa423387c98112b52fc2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fb920ddfaaa423387c98112b52fc2e7 already in progress: creating tablet
I20260807 11:08:52.320405 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:52.323321 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:52.324759 23616 raft_consensus.cc:2379] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99a8d4e2c1b14150b03ad0f28e74a011 in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:08:52.332481 23041 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: default.Table_26baa80665b44b488686b4462963edea [id=97fa5c597042473aac2865ebebf63541] alter complete (version 1)
I20260807 11:08:52.335736 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:52.338081 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:52.338905 23616 raft_consensus.cc:2454] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:08:52.222608 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:52.343597 23045 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 573b681662bc409aa36ccc65e14e9841 consensus state has no leader
I20260807 11:08:52.346416 24598 raft_consensus.cc:482] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.347144 24598 raft_consensus.cc:504] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.350565 24261 tablet_bootstrap.cc:654] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.350535 24598 leader_election.cc:288] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:52.351379 24598 consensus_queue.cc:1035] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:52.352195 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 95) took 1427 ms. Trace:
W20260807 11:08:52.352977 23027 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 43724.1us
I20260807 11:08:52.352895 24506 rpcz_store.cc:276] 0807 11:08:50.924511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:50.924660 (+ 149us) service_pool.cc:227] Handling call
0807 11:08:52.351601 (+1426941us) ts_tablet_manager.cc:1145] Deleting tablet 5eaf45dad4a944dab77330db6fc53222
0807 11:08:52.351654 (+ 53us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:52.352100 (+ 446us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1426154}
I20260807 11:08:52.354453 24262 ts_tablet_manager.cc:1428] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.147s user 0.002s sys 0.006s
I20260807 11:08:52.355475 24262 tablet_bootstrap.cc:492] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:52.354882 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 5eaf45dad4a944dab77330db6fc53222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eaf45dad4a944dab77330db6fc53222 already in progress: creating tablet
I20260807 11:08:52.365372 24593 ts_tablet_manager.cc:1905] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:52.371345 23048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet cc365534189d493a9f3d28bbd4214544
I20260807 11:08:52.371764 23745 leader_election.cc:302] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:52.379484 24018 tablet_service.cc:1514] Processing DeleteTablet for tablet cc365534189d493a9f3d28bbd4214544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.381548 23583 tablet_service.cc:1514] Processing DeleteTablet for tablet cc365534189d493a9f3d28bbd4214544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:52.382979 23796 tablet_service.cc:1514] Processing DeleteTablet for tablet cc365534189d493a9f3d28bbd4214544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.391104 23041 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: default.Table_94d25295c01640a9b6791586b00fe6bb [id=f78c550f25a449ef9d47d66dd609e908] alter complete (version 3)
I20260807 11:08:52.393720 24609 raft_consensus.cc:2781] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:52.394191 24609 raft_consensus.cc:482] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:52.394861 24609 raft_consensus.cc:3037] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:52.394917 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet e254839412ad42fcb6d2e22110d5ee24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:52.395740 24596 ts_tablet_manager.cc:1918] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:52.396312 24596 log.cc:1196] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/42a046eb45bf4d619008ead6f6580713
I20260807 11:08:52.403898 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 96) took 1478 ms. Trace:
I20260807 11:08:52.404464 24506 rpcz_store.cc:276] 0807 11:08:50.925149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:50.925297 (+ 148us) service_pool.cc:227] Handling call
0807 11:08:52.403340 (+1478043us) ts_tablet_manager.cc:1145] Deleting tablet 64cb221021564d66bfecf5cd91bcec5c
0807 11:08:52.403386 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:52.403765 (+ 379us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1477120}
W20260807 11:08:52.406168 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 64cb221021564d66bfecf5cd91bcec5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64cb221021564d66bfecf5cd91bcec5c already in progress: creating tablet
I20260807 11:08:52.406308 24596 ts_tablet_manager.cc:1939] T 42a046eb45bf4d619008ead6f6580713 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:52.407156 24489 raft_consensus.cc:482] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.407904 24489 raft_consensus.cc:504] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.411123 23036 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_34fa3c26a33e4270bb1ee80563113f7e" } new_table_name: "default.Table_88d053e473434f119722cfed9e14a700" modify_external_catalogs: true
I20260807 11:08:52.412079 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "555f31aac90945f8b8a53396a9dbbe4b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:52.412453 24266 tablet_bootstrap.cc:492] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:52.412899 24266 ts_tablet_manager.cc:1397] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.368s user 0.011s sys 0.003s
I20260807 11:08:52.413431 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:56920
W20260807 11:08:52.413841 23510 leader_election.cc:341] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.417187 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "555f31aac90945f8b8a53396a9dbbe4b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:52.418015 23844 raft_consensus.cc:2454] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:52.412873 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 42a046eb45bf4d619008ead6f6580713 (table default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]) successfully deleted
I20260807 11:08:52.418929 24266 raft_consensus.cc:348] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:52.419029 23796 tablet_service.cc:1514] Processing DeleteTablet for tablet e254839412ad42fcb6d2e22110d5ee24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.419581 24266 raft_consensus.cc:374] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:52.419823 24266 raft_consensus.cc:729] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:52.420446 24266 consensus_queue.cc:260] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:52.420850 23507 leader_election.cc:302] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:52.422015 24541 raft_consensus.cc:2781] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:52.422441 24541 raft_consensus.cc:482] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:52.422866 24541 raft_consensus.cc:3037] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:52.423341 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ac76be04eca4d7d9d7f0cf6956fd56a already in progress: creating tablet
I20260807 11:08:52.423590 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet c2049735828546ac9a996d26f6119127 with delete_type TABLET_DATA_DELETED (replaced by tablet d78ed82613064935919934df7124d707) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.429090 24596 tablet_replica.cc:330] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:52.432391 24596 raft_consensus.cc:2229] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:52.434616 24596 raft_consensus.cc:2258] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:52.435405 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_07911aa3b4c244118be60ebcc25a777a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:52.423221 23041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_138bfe750aa94abf9acc8508267751d8" } modify_external_catalogs: true
I20260807 11:08:52.437211 23041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_138bfe750aa94abf9acc8508267751d8" } modify_external_catalogs: true
I20260807 11:08:52.437131 24489 leader_election.cc:288] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:52.428325 23027 catalog_manager.cc:4808] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet cc365534189d493a9f3d28bbd4214544 because the tablet was not found. No further retry: Not found: Tablet not found: cc365534189d493a9f3d28bbd4214544
W20260807 11:08:52.438963 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 67303.7us
I20260807 11:08:52.439317 24506 tablet_replica.cc:330] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:52.440061 24506 raft_consensus.cc:2229] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:52.443910 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07911aa3b4c244118be60ebcc25a777a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:52.444453 24596 ts_tablet_manager.cc:1905] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:52.447299 23046 master_service.cc:946] ReplaceTablet: received request to replace tablet 24d81c13089a44af8eb29400e0de721c from {username='slave'} at 127.0.0.1:53338
W20260807 11:08:52.449904 23745 leader_election.cc:341] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.450786 23745 leader_election.cc:302] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:52.434814 24541 raft_consensus.cc:504] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.467494 24598 raft_consensus.cc:2726] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 11:08:52.468127 24266 ts_tablet_manager.cc:1428] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.055s user 0.006s sys 0.000s
I20260807 11:08:52.468870 24506 raft_consensus.cc:2258] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:52.473070 24609 raft_consensus.cc:504] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.489272 24011 tablet_service.cc:1514] Processing DeleteTablet for tablet 40f0051d83e34bd2ae40986f45b0b8bd with delete_type TABLET_DATA_DELETED (replaced by tablet f4f3bad2ba5e4178b29f52cfb53259db) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.490149 24506 ts_tablet_manager.cc:1905] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:52.491353 23046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 24d81c13089a44af8eb29400e0de721c
I20260807 11:08:52.492657 23046 catalog_manager.cc:6565] ReplaceTablet: tablet 24d81c13089a44af8eb29400e0de721c deleted and replaced by tablet 26e0c103c9724de18cf95897f33a101a
I20260807 11:08:52.494653 24266 tablet_bootstrap.cc:492] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:52.495471 24011 tablet_service.cc:1514] Processing DeleteTablet for tablet 24d81c13089a44af8eb29400e0de721c with delete_type TABLET_DATA_DELETED (replaced by tablet 26e0c103c9724de18cf95897f33a101a) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.500406 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_8dac5f3dbffb4a05ae603c4a2049f9d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:52.507218 23570 tablet_service.cc:1514] Processing DeleteTablet for tablet 24d81c13089a44af8eb29400e0de721c with delete_type TABLET_DATA_DELETED (replaced by tablet 26e0c103c9724de18cf95897f33a101a) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:52.510584 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "555f31aac90945f8b8a53396a9dbbe4b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:52.512010 24541 leader_election.cc:288] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:52.513180 23510 leader_election.cc:341] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.515538 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_e4383b988f6941c9be5c4bbcc5425e76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:52.517416 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_4ca9d06230fb4267b52ca061850a5169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:52.510130 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dac5f3dbffb4a05ae603c4a2049f9d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:52.525812 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ca9d06230fb4267b52ca061850a5169 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:52.476934 24262 tablet_bootstrap.cc:654] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:52.526554 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4383b988f6941c9be5c4bbcc5425e76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:52.478106 23745 consensus_peers.cc:487] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:52.478365 23796 tablet_service.cc:1514] Processing DeleteTablet for tablet 069c0bb933ce4d29976205e0286071eb with delete_type TABLET_DATA_DELETED (replaced by tablet fb1504be4320471687d86a55a9891081) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.484258 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b with delete_type TABLET_DATA_DELETED (replaced by tablet cc48c13644a3401ab34dad398a7f5cd5) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.494699 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet 24d81c13089a44af8eb29400e0de721c with delete_type TABLET_DATA_DELETED (replaced by tablet 26e0c103c9724de18cf95897f33a101a) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.511211 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "555f31aac90945f8b8a53396a9dbbe4b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:52.531687 23844 raft_consensus.cc:3037] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:52.536370 24489 consensus_queue.cc:1035] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:52.538141 24609 leader_election.cc:288] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:08:52.540100 23036 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2013df97d54d43aaa844154c200a5a4f consensus state has no leader
W20260807 11:08:52.530450 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 52535.8us
W20260807 11:08:52.541246 23745 leader_election.cc:341] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.543437 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "555f31aac90945f8b8a53396a9dbbe4b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:52.544731 23616 raft_consensus.cc:2379] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99a8d4e2c1b14150b03ad0f28e74a011 in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:08:52.549935 24261 tablet_bootstrap.cc:492] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:52.550693 24261 ts_tablet_manager.cc:1397] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.307s user 0.006s sys 0.010s
I20260807 11:08:52.551436 23036 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_26baa80665b44b488686b4462963edea" } new_table_name: "default.Table_068a29afd43d4b3389b7c2f992abf956" modify_external_catalogs: true
I20260807 11:08:52.557394 24261 raft_consensus.cc:348] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.558053 24261 raft_consensus.cc:374] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:52.558305 24261 raft_consensus.cc:729] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:52.560547 24596 ts_tablet_manager.cc:1918] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:52.560647 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:52.561197 24596 log.cc:1196] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/cdaf60bc130e4a84b7a309eec3109d61
I20260807 11:08:52.561259 23614 raft_consensus.cc:3037] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:52.562201 24596 ts_tablet_manager.cc:1939] T cdaf60bc130e4a84b7a309eec3109d61 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:52.565121 24262 tablet_bootstrap.cc:492] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:52.565518 24262 ts_tablet_manager.cc:1397] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.210s user 0.006s sys 0.007s
I20260807 11:08:52.569536 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet cdaf60bc130e4a84b7a309eec3109d61 (table default.Table_a536193b9fc2446c9cfad81487d26c97 [id=32b96b2f0b644d94aa4ae5432d615506]) successfully deleted
I20260807 11:08:52.570288 23614 raft_consensus.cc:2454] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:08:52.572602 23844 raft_consensus.cc:2454] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:52.570711 24596 tablet_replica.cc:330] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:52.573907 23507 leader_election.cc:302] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:52.574179 24596 raft_consensus.cc:2229] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:52.575124 24596 pending_rounds.cc:62] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Trying to abort 1 pending ops.
I20260807 11:08:52.575215 24541 raft_consensus.cc:2781] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:52.575714 24541 raft_consensus.cc:686] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:52.576258 24596 pending_rounds.cc:68] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869416017072128 op_type: NO_OP noop_request { }
I20260807 11:08:52.582969 24596 raft_consensus.cc:2866] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:52.583518 24596 raft_consensus.cc:2258] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:52.585281 23043 master_service.cc:946] ReplaceTablet: received request to replace tablet b102e85fa1714a29afbc8302be47921e from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:52.586625 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_325e5ccd9de34794b99618c7a22dd4c7" } modify_external_catalogs: true
I20260807 11:08:52.587184 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_325e5ccd9de34794b99618c7a22dd4c7" } modify_external_catalogs: true
I20260807 11:08:52.576717 24541 consensus_queue.cc:237] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.588485 24596 ts_tablet_manager.cc:1905] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:52.590682 24593 ts_tablet_manager.cc:1918] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:52.593549 24261 consensus_queue.cc:260] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.595988 24262 raft_consensus.cc:348] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.596678 24262 raft_consensus.cc:374] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:52.596922 24262 raft_consensus.cc:729] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:52.599658 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "555f31aac90945f8b8a53396a9dbbe4b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:52.600792 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:52.604192 23510 consensus_peers.cc:487] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:08:52.606423 23745 leader_election.cc:341] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:52.607190 23745 leader_election.cc:341] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.607348 24266 tablet_bootstrap.cc:654] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.608084 23745 leader_election.cc:302] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:52.611091 24261 ts_tablet_manager.cc:1428] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.060s user 0.006s sys 0.001s
I20260807 11:08:52.611956 24261 tablet_bootstrap.cc:492] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:52.619102 24262 consensus_queue.cc:260] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.591214 24593 log.cc:1196] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/42a046eb45bf4d619008ead6f6580713
I20260807 11:08:52.643307 24593 ts_tablet_manager.cc:1939] T 42a046eb45bf4d619008ead6f6580713 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:52.646160 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 42a046eb45bf4d619008ead6f6580713 (table default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]) successfully deleted
I20260807 11:08:52.652594 24541 consensus_queue.cc:1035] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:52.658070 24596 ts_tablet_manager.cc:1918] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:52.661100 24596 log.cc:1196] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:52.661962 24596 ts_tablet_manager.cc:1939] T e254839412ad42fcb6d2e22110d5ee24 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:52.665912 24261 tablet_bootstrap.cc:654] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.670783 24609 raft_consensus.cc:2726] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:52.672523 24262 ts_tablet_manager.cc:1428] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.107s user 0.007s sys 0.000s
I20260807 11:08:52.673447 24262 tablet_bootstrap.cc:492] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:52.675423 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet e254839412ad42fcb6d2e22110d5ee24 (table default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4 [id=ff1332012e264831adffc1c10a065f50]) successfully deleted
I20260807 11:08:52.681416 24596 tablet_replica.cc:330] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:52.681572 24266 tablet_bootstrap.cc:492] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:52.681977 24266 ts_tablet_manager.cc:1397] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.188s user 0.006s sys 0.008s
I20260807 11:08:52.683027 24596 raft_consensus.cc:2229] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:52.683642 24596 raft_consensus.cc:2258] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:52.685837 24596 ts_tablet_manager.cc:1905] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:52.699941 23510 consensus_peers.cc:487] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:08:52.704664 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet cc365534189d493a9f3d28bbd4214544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc365534189d493a9f3d28bbd4214544 already in progress: creating tablet
W20260807 11:08:52.675420 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 67407.6us
I20260807 11:08:52.708458 23745 leader_election.cc:302] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:52.711565 24266 raft_consensus.cc:348] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.712548 24368 raft_consensus.cc:2781] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:52.713238 24368 raft_consensus.cc:686] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:08:52.718086 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_89376166cd0b4be1ad5e90c84f809333"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:52.719641 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89376166cd0b4be1ad5e90c84f809333 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:52.712235 24266 raft_consensus.cc:374] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:52.723631 24266 raft_consensus.cc:729] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:52.727090 24262 tablet_bootstrap.cc:654] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.725099 24266 consensus_queue.cc:260] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.736943 23042 catalog_manager.cc:5495] T 88e76082d4094493a544e18ce9594e20 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: UNKNOWN } } }
I20260807 11:08:52.738807 23042 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
I20260807 11:08:52.744272 24266 ts_tablet_manager.cc:1428] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.062s user 0.004s sys 0.004s
I20260807 11:08:52.753656 24506 ts_tablet_manager.cc:1918] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:52.754304 24506 log.cc:1196] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/3430075bbedd48efbcd78cf6806623ac
I20260807 11:08:52.714648 24368 consensus_queue.cc:237] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.760629 24266 tablet_bootstrap.cc:492] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:52.762369 24011 tablet_service.cc:1467] Processing CreateTablet for tablet a20f0ba778a14d71b9e5efa113c784ff (DEFAULT_TABLE table=default.Table_7c48f335b7db49d3ac516531dcda4561 [id=91a12abc12694046b152c42fedd52521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.764081 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20f0ba778a14d71b9e5efa113c784ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.764173 23040 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_ea80ebfe1316466fbf771f6c3f93a72b" } new_table_name: "default.Table_141ce43640a7454799d89fade48756e6" modify_external_catalogs: true
W20260807 11:08:52.771965 23507 consensus_peers.cc:487] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e254839412ad42fcb6d2e22110d5ee24. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:52.777606 23807 tablet_service.cc:1467] Processing CreateTablet for tablet a20f0ba778a14d71b9e5efa113c784ff (DEFAULT_TABLE table=default.Table_7c48f335b7db49d3ac516531dcda4561 [id=91a12abc12694046b152c42fedd52521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.778687 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20f0ba778a14d71b9e5efa113c784ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.778963 24262 tablet_bootstrap.cc:492] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:52.779356 24262 ts_tablet_manager.cc:1397] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.106s user 0.007s sys 0.008s
I20260807 11:08:52.780009 24008 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4f1adf1fb9450cba3de70397beaa2b (DEFAULT_TABLE table=default.Table_bd4ad9fadca04c0eaa62bf1d0f63e8cb [id=53967af96c72486f9aaa26abffa6fbfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.781781 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4f1adf1fb9450cba3de70397beaa2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.782965 24262 raft_consensus.cc:348] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.783643 24262 raft_consensus.cc:374] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:52.783876 24262 raft_consensus.cc:729] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:52.788516 24262 consensus_queue.cc:260] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.791364 23795 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4f1adf1fb9450cba3de70397beaa2b (DEFAULT_TABLE table=default.Table_bd4ad9fadca04c0eaa62bf1d0f63e8cb [id=53967af96c72486f9aaa26abffa6fbfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.793035 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4f1adf1fb9450cba3de70397beaa2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.793354 24262 ts_tablet_manager.cc:1428] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20260807 11:08:52.797004 24604 raft_consensus.cc:482] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.797434 24604 raft_consensus.cc:504] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:52.799628 24604 leader_election.cc:288] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:52.801646 24262 tablet_bootstrap.cc:492] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:52.803129 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e76082d4094493a544e18ce9594e20" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:52.808872 24649 raft_consensus.cc:482] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.809332 24649 raft_consensus.cc:504] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.811332 24649 leader_election.cc:288] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:52.811992 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc42a1f14754b2fadd8eb5337b87057" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:52.813611 23745 leader_election.cc:341] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.829967 24266 tablet_bootstrap.cc:654] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.837807 24262 tablet_bootstrap.cc:654] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:52.837815 23041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet b3c9141f12804a96994994730996898b
I20260807 11:08:52.840312 23796 tablet_service.cc:1514] Processing DeleteTablet for tablet b3c9141f12804a96994994730996898b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.841396 23043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet b102e85fa1714a29afbc8302be47921e
I20260807 11:08:52.842494 23043 catalog_manager.cc:6565] ReplaceTablet: tablet b102e85fa1714a29afbc8302be47921e deleted and replaced by tablet 6a427e865f1c4d938483a8222a95307e
I20260807 11:08:52.846297 23797 tablet_service.cc:1514] Processing DeleteTablet for tablet b102e85fa1714a29afbc8302be47921e with delete_type TABLET_DATA_DELETED (replaced by tablet 6a427e865f1c4d938483a8222a95307e) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.847723 23796 tablet_service.cc:1467] Processing CreateTablet for tablet cf445e8bf20b46f0831e218bb8eb3397 (DEFAULT_TABLE table=default.Table_325e5ccd9de34794b99618c7a22dd4c7 [id=8b465a032efb467491f8d698f3c8d4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.852260 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet cf445e8bf20b46f0831e218bb8eb3397
I20260807 11:08:52.854694 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf445e8bf20b46f0831e218bb8eb3397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.859623 23797 tablet_service.cc:1514] Processing DeleteTablet for tablet cf445e8bf20b46f0831e218bb8eb3397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:52.865734 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_c3b1895765b44a4eae9efabea2a2e456"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:52.866554 24596 ts_tablet_manager.cc:1918] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260807 11:08:52.867409 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3b1895765b44a4eae9efabea2a2e456 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:52.869408 23040 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ce7963b93094c27b9e25308e68be630 consensus state has no leader
I20260807 11:08:52.870747 23797 tablet_service.cc:1467] Processing CreateTablet for tablet 88a7cbb316e24dd68127b7e13ad6ae68 (DEFAULT_TABLE table=default.Table_57207993c2f443c6841b0228be8fe9b3 [id=a847486f994d4eaab42a77a907556f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.871938 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a7cbb316e24dd68127b7e13ad6ae68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.873279 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 0d81cc2870864a30a62a20921273d55d (DEFAULT_TABLE table=default.Table_ba00760e26b94608849fcc974443fbb3 [id=efe7160043714311b979721eaa5d2b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.874257 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d81cc2870864a30a62a20921273d55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.883054 24013 tablet_service.cc:1514] Processing DeleteTablet for tablet b3c9141f12804a96994994730996898b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.889645 24013 tablet_service.cc:1467] Processing CreateTablet for tablet cf445e8bf20b46f0831e218bb8eb3397 (DEFAULT_TABLE table=default.Table_325e5ccd9de34794b99618c7a22dd4c7 [id=8b465a032efb467491f8d698f3c8d4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.890758 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf445e8bf20b46f0831e218bb8eb3397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.900717 24007 tablet_service.cc:1514] Processing DeleteTablet for tablet b102e85fa1714a29afbc8302be47921e with delete_type TABLET_DATA_DELETED (replaced by tablet 6a427e865f1c4d938483a8222a95307e) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.902769 24262 tablet_bootstrap.cc:492] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:52.903206 24262 ts_tablet_manager.cc:1397] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.102s user 0.014s sys 0.004s
I20260807 11:08:52.904932 24007 tablet_service.cc:1467] Processing CreateTablet for tablet 88a7cbb316e24dd68127b7e13ad6ae68 (DEFAULT_TABLE table=default.Table_57207993c2f443c6841b0228be8fe9b3 [id=a847486f994d4eaab42a77a907556f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.906998 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a7cbb316e24dd68127b7e13ad6ae68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.919376 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e76082d4094493a544e18ce9594e20" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:52.921554 24593 tablet_replica.cc:330] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:52.923328 24593 raft_consensus.cc:2229] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:52.923732 24262 raft_consensus.cc:348] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:52.924445 24262 raft_consensus.cc:374] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:52.924690 24262 raft_consensus.cc:729] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:52.925508 23954 leader_election.cc:302] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:52.926581 24604 raft_consensus.cc:2726] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:52.926211 23570 tablet_service.cc:1467] Processing CreateTablet for tablet a20f0ba778a14d71b9e5efa113c784ff (DEFAULT_TABLE table=default.Table_7c48f335b7db49d3ac516531dcda4561 [id=91a12abc12694046b152c42fedd52521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.928076 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20f0ba778a14d71b9e5efa113c784ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.929129 24604 raft_consensus.cc:482] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.929674 24604 raft_consensus.cc:504] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:52.932709 24604 leader_election.cc:288] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:52.939296 23951 leader_election.cc:341] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 40f0051d83e34bd2ae40986f45b0b8bd
I20260807 11:08:52.941973 23795 tablet_service.cc:1467] Processing CreateTablet for tablet 7a7ccf34faf345998028f67921927f0e (DEFAULT_TABLE table=default.Table_b691ab49ae6a48d4827f493634dc62e7 [id=18d7876a6bec428f8d44a9d68269539a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.943708 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a7ccf34faf345998028f67921927f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.945469 24596 log.cc:1196] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/069c0bb933ce4d29976205e0286071eb
I20260807 11:08:52.955305 24262 consensus_queue.cc:260] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:52.956369 24645 raft_consensus.cc:482] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:52.957216 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet cf445e8bf20b46f0831e218bb8eb3397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:52.956995 24645 raft_consensus.cc:504] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:52.959209 24596 ts_tablet_manager.cc:1939] T 069c0bb933ce4d29976205e0286071eb P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:52.962139 24645 leader_election.cc:288] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:52.963898 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5260c798aa645e5becf393f06528f87" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:52.964908 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5260c798aa645e5becf393f06528f87" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:52.967231 23507 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:52.968827 24506 ts_tablet_manager.cc:1939] T 3430075bbedd48efbcd78cf6806623ac P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:52.970969 24262 ts_tablet_manager.cc:1428] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.067s user 0.005s sys 0.001s
I20260807 11:08:52.971786 24262 tablet_bootstrap.cc:492] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:52.986389 23563 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4f1adf1fb9450cba3de70397beaa2b (DEFAULT_TABLE table=default.Table_bd4ad9fadca04c0eaa62bf1d0f63e8cb [id=53967af96c72486f9aaa26abffa6fbfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:52.987262 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_df7e79722ff6485aadf6bbad482ee7f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:52.988116 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4f1adf1fb9450cba3de70397beaa2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:52.988776 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df7e79722ff6485aadf6bbad482ee7f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:52.991171 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_8dac5f3dbffb4a05ae603c4a2049f9d1" } new_table_name: "default.Table_34d9c6fae3824bf59327e55bbfbff7ae" modify_external_catalogs: true
I20260807 11:08:52.991250 23035 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_0823309bd309430dbddea4d2c1cd4694"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:52.993919 23035 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0823309bd309430dbddea4d2c1cd4694 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:53.014822 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 64c4a0700315457384e3ca995de8a4f2 (DEFAULT_TABLE table=default.Table_b208a091449545bb889b7ffb49a42e09 [id=f7b5878fb01e49a5baf112e8b0a11e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.016466 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc42a1f14754b2fadd8eb5337b87057" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:53.018014 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c4a0700315457384e3ca995de8a4f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.016132 23799 tablet_service.cc:1467] Processing CreateTablet for tablet fb1504be4320471687d86a55a9891081 (DEFAULT_TABLE table=default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.020794 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb1504be4320471687d86a55a9891081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:52.983718 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 0d81cc2870864a30a62a20921273d55d (DEFAULT_TABLE table=default.Table_ba00760e26b94608849fcc974443fbb3 [id=efe7160043714311b979721eaa5d2b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.002731 24018 tablet_service.cc:1467] Processing CreateTablet for tablet b3c9141f12804a96994994730996898b (DEFAULT_TABLE table=default.Table_138bfe750aa94abf9acc8508267751d8 [id=37f351e005454663af54b300832e3c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.026386 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 97) took 1315 ms. Trace:
I20260807 11:08:53.027256 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet b3c9141f12804a96994994730996898b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:53.003926 24009 tablet_service.cc:1467] Processing CreateTablet for tablet 7a7ccf34faf345998028f67921927f0e (DEFAULT_TABLE table=default.Table_b691ab49ae6a48d4827f493634dc62e7 [id=18d7876a6bec428f8d44a9d68269539a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.012502 24012 tablet_service.cc:1467] Processing CreateTablet for tablet 64c4a0700315457384e3ca995de8a4f2 (DEFAULT_TABLE table=default.Table_b208a091449545bb889b7ffb49a42e09 [id=f7b5878fb01e49a5baf112e8b0a11e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.030103 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3c9141f12804a96994994730996898b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:53.032028 23954 leader_election.cc:341] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 40f0051d83e34bd2ae40986f45b0b8bd
I20260807 11:08:53.032588 23954 leader_election.cc:302] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:53.034013 24604 raft_consensus.cc:2726] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:53.035295 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d81cc2870864a30a62a20921273d55d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:53.036612 23510 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.037274 23510 leader_election.cc:302] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:53.038930 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a7ccf34faf345998028f67921927f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.044478 23581 tablet_service.cc:1467] Processing CreateTablet for tablet cf445e8bf20b46f0831e218bb8eb3397 (DEFAULT_TABLE table=default.Table_325e5ccd9de34794b99618c7a22dd4c7 [id=8b465a032efb467491f8d698f3c8d4cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.045522 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf445e8bf20b46f0831e218bb8eb3397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.048919 24012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c4a0700315457384e3ca995de8a4f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.074633 23583 tablet_service.cc:1514] Processing DeleteTablet for tablet b102e85fa1714a29afbc8302be47921e with delete_type TABLET_DATA_DELETED (replaced by tablet 6a427e865f1c4d938483a8222a95307e) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:53.076293 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 88a7cbb316e24dd68127b7e13ad6ae68 (DEFAULT_TABLE table=default.Table_57207993c2f443c6841b0228be8fe9b3 [id=a847486f994d4eaab42a77a907556f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.077272 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a7cbb316e24dd68127b7e13ad6ae68. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:53.066545 23745 leader_election.cc:341] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.080032 23802 tablet_service.cc:1467] Processing CreateTablet for tablet ed62b70f86f3457ab0315ff25e836ec6 (DEFAULT_TABLE table=default.Table_fbc2eeb603af4b3a84797af4a00deb52 [id=9fe3f76ee52549269d443fb394b22540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.081226 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed62b70f86f3457ab0315ff25e836ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.087658 23745 leader_election.cc:302] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:53.100713 23574 tablet_service.cc:1467] Processing CreateTablet for tablet 0d81cc2870864a30a62a20921273d55d (DEFAULT_TABLE table=default.Table_ba00760e26b94608849fcc974443fbb3 [id=efe7160043714311b979721eaa5d2b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.101817 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d81cc2870864a30a62a20921273d55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.113158 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 069c0bb933ce4d29976205e0286071eb (table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]) successfully deleted
I20260807 11:08:53.114244 24596 tablet_replica.cc:330] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:53.114629 24368 raft_consensus.cc:2726] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:53.115836 24596 raft_consensus.cc:2229] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:53.116593 24596 raft_consensus.cc:2258] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:53.118449 23803 tablet_service.cc:1467] Processing CreateTablet for tablet b3c9141f12804a96994994730996898b (DEFAULT_TABLE table=default.Table_138bfe750aa94abf9acc8508267751d8 [id=37f351e005454663af54b300832e3c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.119096 24645 raft_consensus.cc:2726] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:53.120391 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3c9141f12804a96994994730996898b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:53.120172 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 83620.4us
I20260807 11:08:53.121610 24008 tablet_service.cc:1467] Processing CreateTablet for tablet fb1504be4320471687d86a55a9891081 (DEFAULT_TABLE table=default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.122901 23572 tablet_service.cc:1467] Processing CreateTablet for tablet b3c9141f12804a96994994730996898b (DEFAULT_TABLE table=default.Table_138bfe750aa94abf9acc8508267751d8 [id=37f351e005454663af54b300832e3c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.123451 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb1504be4320471687d86a55a9891081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.124503 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3c9141f12804a96994994730996898b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.125913 24017 tablet_service.cc:1467] Processing CreateTablet for tablet ed62b70f86f3457ab0315ff25e836ec6 (DEFAULT_TABLE table=default.Table_fbc2eeb603af4b3a84797af4a00deb52 [id=9fe3f76ee52549269d443fb394b22540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.127748 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed62b70f86f3457ab0315ff25e836ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.141585 24261 tablet_bootstrap.cc:492] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:53.142037 24261 ts_tablet_manager.cc:1397] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.530s user 0.014s sys 0.011s
I20260807 11:08:53.147483 24506 rpcz_store.cc:276] 0807 11:08:51.710607 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:51.711184 (+ 577us) service_pool.cc:227] Handling call
0807 11:08:52.439140 (+727956us) ts_tablet_manager.cc:1145] Deleting tablet 3430075bbedd48efbcd78cf6806623ac
0807 11:08:52.439190 (+ 50us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:52.674678 (+235488us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:52.753326 (+ 78648us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.026294 (+272968us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28133,"tablet-delete.queue_time_us":727390}
I20260807 11:08:53.151149 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 7a7ccf34faf345998028f67921927f0e (DEFAULT_TABLE table=default.Table_b691ab49ae6a48d4827f493634dc62e7 [id=18d7876a6bec428f8d44a9d68269539a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.152156 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a7ccf34faf345998028f67921927f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.165709 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_569cf9c221e6433882d3ec68cfb4d437"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:53.167445 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_569cf9c221e6433882d3ec68cfb4d437 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:53.177796 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 60740.1us
I20260807 11:08:53.184644 24593 raft_consensus.cc:2258] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:53.187885 24266 tablet_bootstrap.cc:492] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:53.188424 24266 ts_tablet_manager.cc:1397] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.428s user 0.010s sys 0.004s
I20260807 11:08:53.195513 23036 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_caa47803b29d4efeb2c70fc09f48e17d" } modify_external_catalogs: true
I20260807 11:08:53.196007 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 103) took 1320 ms. Trace:
I20260807 11:08:53.196360 23036 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_caa47803b29d4efeb2c70fc09f48e17d" } modify_external_catalogs: true
I20260807 11:08:53.196580 24506 rpcz_store.cc:276] 0807 11:08:51.875487 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:51.875616 (+ 129us) service_pool.cc:227] Handling call
0807 11:08:53.195438 (+1319822us) ts_tablet_manager.cc:1145] Deleting tablet 069c0bb933ce4d29976205e0286071eb
0807 11:08:53.195528 (+ 90us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.195911 (+ 383us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319005}
I20260807 11:08:53.211195 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet cf445e8bf20b46f0831e218bb8eb3397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:52 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:53.147854 24596 ts_tablet_manager.cc:1905] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:53.214346 23046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a70046e0e22b47878d24ab3c264af9cc" } modify_external_catalogs: true
I20260807 11:08:53.214938 23046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a70046e0e22b47878d24ab3c264af9cc" } modify_external_catalogs: true
I20260807 11:08:53.225266 24593 ts_tablet_manager.cc:1905] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:53.231863 23030 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6ce7963b93094c27b9e25308e68be630 (table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ce7963b93094c27b9e25308e68be630 consensus state has no leader
I20260807 11:08:53.233238 23571 tablet_service.cc:1467] Processing CreateTablet for tablet fb1504be4320471687d86a55a9891081 (DEFAULT_TABLE table=default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.235256 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 3430075bbedd48efbcd78cf6806623ac (table default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]) successfully deleted
W20260807 11:08:53.236186 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 069c0bb933ce4d29976205e0286071eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 069c0bb933ce4d29976205e0286071eb already in progress: creating tablet
I20260807 11:08:53.252183 24266 raft_consensus.cc:348] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.252884 24266 raft_consensus.cc:374] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.253156 24266 raft_consensus.cc:729] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.253835 24266 consensus_queue.cc:260] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.255872 24266 ts_tablet_manager.cc:1428] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.067s user 0.004s sys 0.001s
I20260807 11:08:53.256387 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 105) took 1305 ms. Trace:
I20260807 11:08:53.261735 24262 tablet_bootstrap.cc:654] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.257295 24506 rpcz_store.cc:276] 0807 11:08:51.951084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:51.951264 (+ 180us) service_pool.cc:227] Handling call
0807 11:08:53.252420 (+1301156us) ts_tablet_manager.cc:1145] Deleting tablet d5260c798aa645e5becf393f06528f87
0807 11:08:53.252483 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.256292 (+ 3809us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1300056}
W20260807 11:08:53.249014 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aea90f7a10234f2da4fff089afe87a1e has no consensus state
W20260807 11:08:53.246816 23042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.22.115.193:60085 (request call id 34) took 808 ms (client timeout 1000 ms). Trace:
I20260807 11:08:53.261969 23043 catalog_manager.cc:5495] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:08:53.284376 23043 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
W20260807 11:08:53.279628 23042 rpcz_store.cc:269] 0807 11:08:52.438877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.438977 (+ 100us) service_pool.cc:227] Handling call
0807 11:08:53.246751 (+807774us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:52.851155 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:52.854817 (+ 3662us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:52.854884 (+ 67us) write_op.cc:435] Acquired schema lock
0807 11:08:52.854897 (+ 13us) tablet.cc:660] Decoding operations
0807 11:08:52.855144 (+ 247us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:52.855179 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:52.855198 (+ 19us) tablet.cc:683] Acquiring locks for 1 operations
0807 11:08:52.855326 (+ 128us) tablet.cc:699] Row locks acquired
0807 11:08:52.855339 (+ 13us) write_op.cc:260] PREPARE: finished
0807 11:08:52.855454 (+ 115us) write_op.cc:270] Start()
0807 11:08:52.855526 (+ 72us) write_op.cc:276] Timestamp: P: 1786100932855394 usec, L: 0
0807 11:08:52.855540 (+ 14us) op_driver.cc:331] REPLICATION: starting
0807 11:08:52.856870 (+ 1330us) log.cc:842] Serialized 536 byte log entry
0807 11:08:53.234012 (+377142us) op_driver.cc:444] REPLICATION: finished
0807 11:08:53.235482 (+ 1470us) write_op.cc:301] APPLY: starting
0807 11:08:53.235578 (+ 96us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:53.235725 (+ 147us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:53.235849 (+ 124us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:53.236080 (+ 231us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:53.236367 (+ 287us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 11:08:53.236413 (+ 46us) write_op.cc:312] APPLY: finished
0807 11:08:53.236745 (+ 332us) log.cc:842] Serialized 23 byte log entry
0807 11:08:53.237015 (+ 270us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:53.237134 (+ 119us) write_op.cc:454] Released schema lock
0807 11:08:53.237166 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0807 11:08:53.237536 (+ 370us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:53.237586 (+ 50us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":1232,"apply.run_cpu_time_us":2294,"apply.run_wall_time_us":2293,"mutex_wait_us":59125,"num_ops":1,"prepare.queue_time_us":76658,"prepare.run_cpu_time_us":1788,"prepare.run_wall_time_us":6818,"replication_time_us":378338}]]}
W20260807 11:08:53.323141 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet d5260c798aa645e5becf393f06528f87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5260c798aa645e5becf393f06528f87 already in progress: creating tablet
I20260807 11:08:53.334895 24604 raft_consensus.cc:482] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:53.335644 24604 raft_consensus.cc:504] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.341351 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:53.343075 24604 leader_election.cc:288] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:53.342643 23844 raft_consensus.cc:2379] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in this term.
I20260807 11:08:53.355731 24266 tablet_bootstrap.cc:492] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:53.353565 24262 tablet_bootstrap.cc:492] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:53.357028 24262 ts_tablet_manager.cc:1397] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.385s user 0.002s sys 0.016s
I20260807 11:08:53.361703 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 108) took 1148 ms. Trace:
I20260807 11:08:53.362206 24506 rpcz_store.cc:276] 0807 11:08:52.213324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.214209 (+ 885us) service_pool.cc:227] Handling call
0807 11:08:53.283103 (+1068894us) ts_tablet_manager.cc:1145] Deleting tablet 2ac76be04eca4d7d9d7f0cf6956fd56a
0807 11:08:53.361128 (+ 78025us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.361616 (+ 488us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1034399}
I20260807 11:08:53.364029 24506 tablet_replica.cc:330] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:53.359575 24262 raft_consensus.cc:348] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.364923 24262 raft_consensus.cc:374] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.365257 24262 raft_consensus.cc:729] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.365461 24506 raft_consensus.cc:2229] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:53.366083 24506 raft_consensus.cc:2258] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 11:08:53.367898 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ac76be04eca4d7d9d7f0cf6956fd56a already in progress: creating tablet
I20260807 11:08:53.369275 24262 consensus_queue.cc:260] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.372960 24368 raft_consensus.cc:482] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:53.378841 24368 raft_consensus.cc:504] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.379467 23581 tablet_service.cc:1467] Processing CreateTablet for tablet 64c4a0700315457384e3ca995de8a4f2 (DEFAULT_TABLE table=default.Table_b208a091449545bb889b7ffb49a42e09 [id=f7b5878fb01e49a5baf112e8b0a11e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.380849 24368 leader_election.cc:288] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:53.382939 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b102e85fa1714a29afbc8302be47921e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:53.384661 23745 leader_election.cc:341] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.387382 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb1504be4320471687d86a55a9891081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.370729 23580 tablet_service.cc:1467] Processing CreateTablet for tablet ed62b70f86f3457ab0315ff25e836ec6 (DEFAULT_TABLE table=default.Table_fbc2eeb603af4b3a84797af4a00deb52 [id=9fe3f76ee52549269d443fb394b22540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:53.392589 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed62b70f86f3457ab0315ff25e836ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.395550 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c4a0700315457384e3ca995de8a4f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:53.402920 24262 ts_tablet_manager.cc:1428] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.046s user 0.005s sys 0.002s
I20260807 11:08:53.376443 24596 ts_tablet_manager.cc:1918] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:53.410953 24596 log.cc:1196] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/555f31aac90945f8b8a53396a9dbbe4b
I20260807 11:08:53.411377 24262 tablet_bootstrap.cc:492] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:53.415550 24596 ts_tablet_manager.cc:1939] T 555f31aac90945f8b8a53396a9dbbe4b P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:53.427693 24596 tablet_replica.cc:330] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:53.428556 24596 raft_consensus.cc:2229] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:53.429517 24596 raft_consensus.cc:2258] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:53.435827 24262 tablet_bootstrap.cc:654] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.447654 24596 ts_tablet_manager.cc:1905] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:53.456027 23045 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_94d25295c01640a9b6791586b00fe6bb" } new_table_name: "default.Table_5d43d9d3c3a742dbb89c2d3827b71afd" modify_external_catalogs: true
W20260807 11:08:53.469412 23027 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 114833us
I20260807 11:08:53.471684 24262 tablet_bootstrap.cc:492] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:53.472155 24262 ts_tablet_manager.cc:1397] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.006s
I20260807 11:08:53.475713 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 555f31aac90945f8b8a53396a9dbbe4b (table default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]) successfully deleted
I20260807 11:08:53.477156 24262 raft_consensus.cc:348] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.477855 24262 raft_consensus.cc:374] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.478089 24262 raft_consensus.cc:729] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.491946 24262 consensus_queue.cc:260] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.497664 24368 raft_consensus.cc:482] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:53.498137 24368 raft_consensus.cc:504] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.500221 24368 leader_election.cc:288] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:53.503131 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5260c798aa645e5becf393f06528f87" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:53.504879 23745 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.510269 24262 ts_tablet_manager.cc:1428] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.038s user 0.006s sys 0.002s
I20260807 11:08:53.519693 24262 tablet_bootstrap.cc:492] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:53.543579 24506 ts_tablet_manager.cc:1905] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:53.498945 23036 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 1ce42b3bd73242418f510c5b83259238
I20260807 11:08:53.500058 23046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet f4f3bad2ba5e4178b29f52cfb53259db
I20260807 11:08:53.546406 24009 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce42b3bd73242418f510c5b83259238 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:53.525076 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_00074ee5a1be4b9fbae6fb1643a94009" } new_table_name: "default.Table_63fec34778c14f0f91bd30125c2c071a" modify_external_catalogs: true
I20260807 11:08:53.525214 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_372ec524768f4c7e8b6914a92ab6d793"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:53.551342 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_372ec524768f4c7e8b6914a92ab6d793 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:53.536578 23042 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
I20260807 11:08:53.555991 24596 ts_tablet_manager.cc:1918] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260807 11:08:53.556519 24596 log.cc:1196] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/24d81c13089a44af8eb29400e0de721c
I20260807 11:08:53.557389 24596 ts_tablet_manager.cc:1939] T 24d81c13089a44af8eb29400e0de721c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:53.557691 24262 tablet_bootstrap.cc:654] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.560693 24596 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 116) took 1066 ms. Trace:
I20260807 11:08:53.562048 24009 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f3bad2ba5e4178b29f52cfb53259db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:53.561215 24596 rpcz_store.cc:276] 0807 11:08:52.494233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.494519 (+ 286us) service_pool.cc:227] Handling call
0807 11:08:53.427483 (+932964us) ts_tablet_manager.cc:1145] Deleting tablet 24d81c13089a44af8eb29400e0de721c
0807 11:08:53.427551 (+ 68us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.493998 (+ 66447us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.555645 (+ 61647us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.560623 (+ 4978us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":896217}
I20260807 11:08:53.564353 24596 tablet_replica.cc:330] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:53.565277 24596 raft_consensus.cc:2229] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:53.565809 24596 raft_consensus.cc:2258] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:53.568003 24596 ts_tablet_manager.cc:1905] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:53.540722 23045 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26e0c103c9724de18cf95897f33a101a has no consensus state
I20260807 11:08:53.587065 24596 ts_tablet_manager.cc:1918] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:53.587466 24596 log.cc:1196] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/b102e85fa1714a29afbc8302be47921e
I20260807 11:08:53.588191 24596 ts_tablet_manager.cc:1939] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
W20260807 11:08:53.544490 23027 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 68775.3us
W20260807 11:08:53.602690 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84c78502f0a5485c9ffe4434c14567e0 consensus state has no leader
I20260807 11:08:53.608268 23803 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:48 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:53.609046 23803 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce42b3bd73242418f510c5b83259238 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:53.609896 23803 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f3bad2ba5e4178b29f52cfb53259db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:53.610483 24596 tablet_replica.cc:330] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:53.610687 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_5d43d9d3c3a742dbb89c2d3827b71afd [id=f78c550f25a449ef9d47d66dd609e908]) successfully deleted
I20260807 11:08:53.611307 24596 raft_consensus.cc:2229] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:53.611748 24596 raft_consensus.cc:2258] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260807 11:08:53.611337 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet b3c9141f12804a96994994730996898b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3c9141f12804a96994994730996898b already in progress: creating tablet
I20260807 11:08:53.612948 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet b102e85fa1714a29afbc8302be47921e (table default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]) successfully deleted
I20260807 11:08:53.613382 24596 ts_tablet_manager.cc:1905] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:53.613579 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet cf445e8bf20b46f0831e218bb8eb3397 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf445e8bf20b46f0831e218bb8eb3397 already in progress: creating tablet
W20260807 11:08:53.614091 23027 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 -> Peer b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555): Couldn't send request to peer b43b3e5203ee4ac3a23fa1902356994b. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.252:40555: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 11:08:53.618083 24262 tablet_bootstrap.cc:492] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:53.618482 24262 ts_tablet_manager.cc:1397] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.099s user 0.019s sys 0.011s
I20260807 11:08:53.620970 24262 raft_consensus.cc:348] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.621584 24262 raft_consensus.cc:374] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.621821 24262 raft_consensus.cc:729] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.622463 24262 consensus_queue.cc:260] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.601547 24266 tablet_bootstrap.cc:654] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.624383 24262 ts_tablet_manager.cc:1428] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 11:08:53.626391 24262 tablet_bootstrap.cc:492] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:53.636466 24596 ts_tablet_manager.cc:1918] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:53.636817 24596 log.cc:1196] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/9fc42a1f14754b2fadd8eb5337b87057
I20260807 11:08:53.637429 24596 ts_tablet_manager.cc:1939] T 9fc42a1f14754b2fadd8eb5337b87057 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:53.642488 24262 tablet_bootstrap.cc:654] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.643458 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6f8c96453d0f4d3f8465677953583882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:53.643271 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 9fc42a1f14754b2fadd8eb5337b87057 (table default.Table_06348463068444bfa120534ced7a9e25 [id=02196e29e7f34f2cb49d83c13053ca2d]) successfully deleted
W20260807 11:08:53.646517 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f8c96453d0f4d3f8465677953583882 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:53.646992 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 1ce42b3bd73242418f510c5b83259238 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ce42b3bd73242418f510c5b83259238 already in progress: creating tablet
I20260807 11:08:53.655010 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_3296c53524e341ea9bd1f69a41aec0c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:53.658329 24368 raft_consensus.cc:482] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:53.658815 24368 raft_consensus.cc:504] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:53.660975 24368 leader_election.cc:288] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:53.664583 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0071aac25afa4100b98c4811cf3e6b2e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:53.666667 24266 tablet_bootstrap.cc:492] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
W20260807 11:08:53.667016 23745 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.667690 24506 ts_tablet_manager.cc:1918] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:53.675182 24506 log.cc:1196] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/42a046eb45bf4d619008ead6f6580713
I20260807 11:08:53.676122 24506 ts_tablet_manager.cc:1939] T 42a046eb45bf4d619008ead6f6580713 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:53.679783 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 107) took 1524 ms. Trace:
I20260807 11:08:53.680171 24506 rpcz_store.cc:276] 0807 11:08:52.155567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.250464 (+ 94897us) service_pool.cc:227] Handling call
0807 11:08:53.363780 (+1113316us) ts_tablet_manager.cc:1145] Deleting tablet 42a046eb45bf4d619008ead6f6580713
0807 11:08:53.363820 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.609900 (+246080us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.667458 (+ 57558us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.679723 (+ 12265us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1090708}
I20260807 11:08:53.681456 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 42a046eb45bf4d619008ead6f6580713 (table default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]) successfully deleted
I20260807 11:08:53.683203 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 109) took 1305 ms. Trace:
I20260807 11:08:53.683962 24506 rpcz_store.cc:276] 0807 11:08:52.377915 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.378130 (+ 215us) service_pool.cc:227] Handling call
0807 11:08:53.682804 (+1304674us) ts_tablet_manager.cc:1145] Deleting tablet cc365534189d493a9f3d28bbd4214544
0807 11:08:53.682846 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.683153 (+ 307us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302702}
W20260807 11:08:53.685204 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet cc365534189d493a9f3d28bbd4214544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc365534189d493a9f3d28bbd4214544 already in progress: creating tablet
I20260807 11:08:53.686074 24506 tablet_replica.cc:330] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:53.686836 24506 raft_consensus.cc:2229] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:53.688583 24506 raft_consensus.cc:2258] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:53.675208 24266 ts_tablet_manager.cc:1397] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.320s user 0.010s sys 0.006s
I20260807 11:08:53.693327 24266 raft_consensus.cc:348] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.699083 24262 tablet_bootstrap.cc:492] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:53.699927 24262 ts_tablet_manager.cc:1397] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.074s user 0.010s sys 0.000s
I20260807 11:08:53.703186 23042 master_service.cc:946] ReplaceTablet: received request to replace tablet 8a2df15b35bd435baaf95a708ec85a37 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:53.703691 24266 raft_consensus.cc:374] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.704044 24266 raft_consensus.cc:729] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.700531 24506 ts_tablet_manager.cc:1905] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:53.704202 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_1e2e0850d0394751b215be889b722ade"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:53.708380 23745 consensus_peers.cc:487] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:53.709025 24266 consensus_queue.cc:260] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:53.709582 23563 consensus_meta.cc:287] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93: Time spent flushing consensus metadata: real 0.619s user 0.004s sys 0.007s
I20260807 11:08:53.711318 24266 ts_tablet_manager.cc:1428] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.020s user 0.002s sys 0.003s
I20260807 11:08:53.702960 24262 raft_consensus.cc:348] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.711875 24262 raft_consensus.cc:374] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.712169 24262 raft_consensus.cc:729] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.725325 24262 consensus_queue.cc:260] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.726222 24266 tablet_bootstrap.cc:492] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:53.733351 24262 ts_tablet_manager.cc:1428] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.032s user 0.004s sys 0.000s
I20260807 11:08:53.735532 24262 tablet_bootstrap.cc:492] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:53.745611 24368 raft_consensus.cc:482] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:53.746058 24368 raft_consensus.cc:504] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.747970 24368 leader_election.cc:288] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:53.748600 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0071aac25afa4100b98c4811cf3e6b2e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:53.750962 23608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c78502f0a5485c9ffe4434c14567e0" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:53.752480 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c78502f0a5485c9ffe4434c14567e0" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:53.753634 23745 leader_election.cc:341] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:53.754343 23745 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.754698 23745 leader_election.cc:302] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:53.754837 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5260c798aa645e5becf393f06528f87" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:53.755548 23613 raft_consensus.cc:2454] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
W20260807 11:08:53.755766 23745 leader_election.cc:341] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.756197 24266 tablet_bootstrap.cc:654] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.756116 23745 leader_election.cc:302] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:53.757550 24368 raft_consensus.cc:2726] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:53.757462 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b102e85fa1714a29afbc8302be47921e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:53.758074 24368 raft_consensus.cc:2726] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:53.763782 24261 raft_consensus.cc:348] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:53.764676 24261 raft_consensus.cc:374] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.765450 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_465ca808156842049f2134ae0e427b18" } modify_external_catalogs: true
I20260807 11:08:53.765988 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_465ca808156842049f2134ae0e427b18" } modify_external_catalogs: true
I20260807 11:08:53.767531 23745 leader_election.cc:302] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:53.767593 23043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_63fec34778c14f0f91bd30125c2c071a" } modify_external_catalogs: true
I20260807 11:08:53.768039 23043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_63fec34778c14f0f91bd30125c2c071a" } modify_external_catalogs: true
W20260807 11:08:53.768522 23745 leader_election.cc:341] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.768869 23745 leader_election.cc:302] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:53.764951 24261 raft_consensus.cc:729] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
W20260807 11:08:53.769379 23745 raft_consensus.cc:2670] T b102e85fa1714a29afbc8302be47921e P 99a8d4e2c1b14150b03ad0f28e74a011: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 11:08:53.770115 24261 consensus_queue.cc:260] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:53.771147 24368 raft_consensus.cc:2781] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:53.771456 24368 raft_consensus.cc:482] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:53.771727 24368 raft_consensus.cc:3037] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:53.772912 24506 ts_tablet_manager.cc:1918] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:53.773257 24506 log.cc:1196] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/c2049735828546ac9a996d26f6119127
I20260807 11:08:53.773852 24506 ts_tablet_manager.cc:1939] T c2049735828546ac9a996d26f6119127 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:53.778637 24266 tablet_bootstrap.cc:492] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:53.778311 24368 raft_consensus.cc:504] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.779107 24266 ts_tablet_manager.cc:1397] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.000s
I20260807 11:08:53.780362 24368 leader_election.cc:288] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:53.781113 24261 ts_tablet_manager.cc:1428] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.639s user 0.018s sys 0.005s
W20260807 11:08:53.781452 24261 ts_tablet_manager.cc:1460] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Tablet startup took 639ms
I20260807 11:08:53.780882 24729 consensus_queue.cc:1035] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:53.783728 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b with delete_type TABLET_DATA_DELETED (replaced by tablet cc48c13644a3401ab34dad398a7f5cd5) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:53.783893 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_569cf9c221e6433882d3ec68cfb4d437" } new_table_name: "default.Table_dd11d15b474c4c79bc79b7ad57408040" modify_external_catalogs: true
I20260807 11:08:53.784089 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5260c798aa645e5becf393f06528f87" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:53.784977 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet d5260c798aa645e5becf393f06528f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:53.785991 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ce42b3bd73242418f510c5b83259238 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:53.781268 24266 raft_consensus.cc:348] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.787431 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f3bad2ba5e4178b29f52cfb53259db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:53.786474 24266 raft_consensus.cc:374] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.789472 24266 raft_consensus.cc:729] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.790829 24266 consensus_queue.cc:260] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.790356 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 110) took 1368 ms. Trace:
I20260807 11:08:53.792717 24506 rpcz_store.cc:276] 0807 11:08:52.422119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.423392 (+ 1273us) service_pool.cc:227] Handling call
0807 11:08:53.685911 (+1262519us) ts_tablet_manager.cc:1145] Deleting tablet c2049735828546ac9a996d26f6119127
0807 11:08:53.685968 (+ 57us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.737716 (+ 51748us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.772676 (+ 34960us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.790297 (+ 17621us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1260047}
I20260807 11:08:53.797246 24262 tablet_bootstrap.cc:654] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.802455 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5260c798aa645e5becf393f06528f87" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:53.803078 23616 raft_consensus.cc:3037] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:53.806337 23037 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_df7e79722ff6485aadf6bbad482ee7f3" } new_table_name: "default.Table_bec911c7a8ae4fed9cb275b53592d0fd" modify_external_catalogs: true
I20260807 11:08:53.810313 23616 raft_consensus.cc:2454] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
W20260807 11:08:53.781719 24261 ts_tablet_manager.cc:1462] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Trace:
0807 11:08:47.983893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:47.984023 (+ 130us) service_pool.cc:227] Handling call
0807 11:08:47.986243 (+ 2220us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 11:08:47.986326 (+ 83us) ts_tablet_manager.cc:676] Creating new metadata...
0807 11:08:48.175160 (+188834us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:48.434789 (+259629us) tablet_replica.cc:205] Creating consensus instance
0807 11:08:48.450121 (+ 15332us) inbound_call.cc:173] Queueing success response
0807 11:08:52.611707 (+4161586us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 11:08:53.142286 (+530579us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 11:08:53.167738 (+ 25452us) tablet_replica.cc:259] Starting instrumentation
0807 11:08:53.170981 (+ 3243us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":18488,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":596,"tablet-open.queue_time_us":4161687}
W20260807 11:08:53.811403 23745 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:53.819409 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet c2049735828546ac9a996d26f6119127 (table default.Table_bfdb65009c1f4abebd979f0ebc8d41d5 [id=d5c79d7bd03641dda09bcd556f2f64bf]) successfully deleted
I20260807 11:08:53.820370 24506 tablet_replica.cc:330] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:53.821069 24506 raft_consensus.cc:2229] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:53.821496 24506 raft_consensus.cc:2258] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:53.823508 24266 ts_tablet_manager.cc:1428] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.044s user 0.003s sys 0.003s
I20260807 11:08:53.824630 24262 tablet_bootstrap.cc:492] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:53.825052 24262 ts_tablet_manager.cc:1397] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.090s user 0.007s sys 0.003s
I20260807 11:08:53.826890 24266 tablet_bootstrap.cc:492] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:53.827306 24262 raft_consensus.cc:348] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.827946 24262 raft_consensus.cc:374] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.828181 24262 raft_consensus.cc:729] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.828743 24262 consensus_queue.cc:260] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.829685 24734 raft_consensus.cc:482] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:53.830116 24734 raft_consensus.cc:504] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.831255 24506 ts_tablet_manager.cc:1905] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:53.832811 23745 leader_election.cc:302] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:53.833097 24262 ts_tablet_manager.cc:1428] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260807 11:08:53.834461 24729 raft_consensus.cc:2781] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:53.834630 24734 leader_election.cc:288] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:53.834916 24729 raft_consensus.cc:686] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:08:53.835696 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655d379cab56486d872738de6acdffef" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:53.836279 23846 raft_consensus.cc:2454] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:53.835697 24729 consensus_queue.cc:237] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:53.837646 23507 leader_election.cc:302] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:53.839596 24261 tablet_bootstrap.cc:492] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:53.843044 24489 raft_consensus.cc:2781] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:53.843390 24489 raft_consensus.cc:482] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:53.843732 24489 raft_consensus.cc:3037] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:53.844991 23507 consensus_peers.cc:487] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 555f31aac90945f8b8a53396a9dbbe4b. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:53.846956 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_9b7a6afec0d2423ea15d59b70e646e8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:53.852135 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b7a6afec0d2423ea15d59b70e646e8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:53.852332 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e2e0850d0394751b215be889b722ade in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:53.851173 24262 tablet_bootstrap.cc:492] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:53.853979 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3296c53524e341ea9bd1f69a41aec0c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:53.647689 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet f4f3bad2ba5e4178b29f52cfb53259db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f3bad2ba5e4178b29f52cfb53259db already in progress: creating tablet
W20260807 11:08:53.855043 23027 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 207361us
I20260807 11:08:53.868453 24266 tablet_bootstrap.cc:654] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.885500 24262 tablet_bootstrap.cc:654] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:53.895237 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c7d0cab3da641f4abca60a8beff381e has no consensus state
W20260807 11:08:53.900923 23037 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e965a1dc66c414285df6727d2982e12 has no consensus state
I20260807 11:08:53.901059 24262 tablet_bootstrap.cc:492] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:53.901464 24262 ts_tablet_manager.cc:1397] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.050s user 0.010s sys 0.003s
I20260807 11:08:53.903635 24262 raft_consensus.cc:348] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.904244 24262 raft_consensus.cc:374] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.904479 24262 raft_consensus.cc:729] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.915416 24262 consensus_queue.cc:260] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.920552 24262 ts_tablet_manager.cc:1428] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.019s user 0.006s sys 0.001s
I20260807 11:08:53.926016 24266 tablet_bootstrap.cc:492] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:53.926580 24266 ts_tablet_manager.cc:1397] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.100s user 0.007s sys 0.003s
I20260807 11:08:53.937306 24262 tablet_bootstrap.cc:492] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:53.939096 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 60737.6us
I20260807 11:08:53.946673 24506 ts_tablet_manager.cc:1918] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:53.947053 24506 log.cc:1196] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/40f0051d83e34bd2ae40986f45b0b8bd
I20260807 11:08:53.947698 24506 ts_tablet_manager.cc:1939] T 40f0051d83e34bd2ae40986f45b0b8bd P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:53.948159 24266 raft_consensus.cc:348] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.948800 24266 raft_consensus.cc:374] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:53.949260 24266 raft_consensus.cc:729] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:53.949396 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 111) took 1460 ms. Trace:
I20260807 11:08:53.949915 24266 consensus_queue.cc:260] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.953018 24262 tablet_bootstrap.cc:654] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:53.949682 24506 rpcz_store.cc:276] 0807 11:08:52.488853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.489044 (+ 191us) service_pool.cc:227] Handling call
0807 11:08:53.820197 (+1331153us) ts_tablet_manager.cc:1145] Deleting tablet 40f0051d83e34bd2ae40986f45b0b8bd
0807 11:08:53.820245 (+ 48us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.909891 (+ 89646us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.946423 (+ 36532us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.949341 (+ 2918us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1330274}
I20260807 11:08:53.955117 24506 tablet_replica.cc:330] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:53.955711 24506 raft_consensus.cc:2229] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:53.956130 24506 raft_consensus.cc:2258] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:53.957743 24506 ts_tablet_manager.cc:1905] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:53.961701 24266 ts_tablet_manager.cc:1428] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260807 11:08:53.968418 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:53.970023 23616 raft_consensus.cc:2379] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:08:53.974589 24055 raft_consensus.cc:3037] T 88e76082d4094493a544e18ce9594e20 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:53.979789 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655d379cab56486d872738de6acdffef" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:53.981055 23954 leader_election.cc:302] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:53.982126 24604 raft_consensus.cc:3037] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:53.982210 24645 raft_consensus.cc:482] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:53.982585 24645 raft_consensus.cc:504] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:53.984748 24645 leader_election.cc:288] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:53.966744 24593 ts_tablet_manager.cc:1918] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:53.986660 24593 log.cc:1196] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:53.987675 24593 ts_tablet_manager.cc:1939] T e254839412ad42fcb6d2e22110d5ee24 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:53.991361 24262 tablet_bootstrap.cc:492] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:53.991204 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0071aac25afa4100b98c4811cf3e6b2e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:53.991752 24262 ts_tablet_manager.cc:1397] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.055s user 0.014s sys 0.002s
I20260807 11:08:53.991842 23846 raft_consensus.cc:2454] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:53.994015 24262 raft_consensus.cc:348] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:53.995129 23507 leader_election.cc:302] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:53.995807 24755 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260807 11:08:53.996542 23041 master_service.cc:946] ReplaceTablet: received request to replace tablet 5fb920ddfaaa423387c98112b52fc2e7 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:53.996901 24604 raft_consensus.cc:2726] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:53.998967 24632 raft_consensus.cc:2781] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:53.999300 24632 raft_consensus.cc:482] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:53.999624 24632 raft_consensus.cc:3037] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:54.004765 24489 raft_consensus.cc:504] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:54.006735 24489 leader_election.cc:288] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:53.994683 24262 raft_consensus.cc:374] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.007833 24262 raft_consensus.cc:729] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.011101 24262 consensus_queue.cc:260] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.011916 24261 tablet_bootstrap.cc:654] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.013034 24262 ts_tablet_manager.cc:1428] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260807 11:08:54.013446 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655d379cab56486d872738de6acdffef" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:54.013980 23844 raft_consensus.cc:3037] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:54.015929 24368 raft_consensus.cc:482] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.016685 24506 ts_tablet_manager.cc:1918] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260807 11:08:54.016342 24368 raft_consensus.cc:504] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.017031 24506 log.cc:1196] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/24d81c13089a44af8eb29400e0de721c
I20260807 11:08:54.017729 24506 ts_tablet_manager.cc:1939] T 24d81c13089a44af8eb29400e0de721c P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:54.018447 24368 leader_election.cc:288] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:54.021018 23844 raft_consensus.cc:2454] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:54.023674 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 111) took 1631 ms. Trace:
I20260807 11:08:54.024384 24262 tablet_bootstrap.cc:492] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:54.024590 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ac76be04eca4d7d9d7f0cf6956fd56a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:54.025807 24266 tablet_bootstrap.cc:492] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:54.036578 23507 leader_election.cc:302] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:08:54.038626 23745 leader_election.cc:341] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.039467 24731 raft_consensus.cc:2781] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:54.040064 24731 raft_consensus.cc:686] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:54.041996 24262 tablet_bootstrap.cc:654] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.052626 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_5764652d8e704dc8ac79eca55fcda6f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:54.054069 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5764652d8e704dc8ac79eca55fcda6f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.062373 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ac76be04eca4d7d9d7f0cf6956fd56a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:54.043476 24731 consensus_queue.cc:237] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:54.066478 24262 tablet_bootstrap.cc:492] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:54.024051 24593 rpcz_store.cc:276] 0807 11:08:52.392689 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.394740 (+ 2051us) service_pool.cc:227] Handling call
0807 11:08:52.921358 (+526618us) ts_tablet_manager.cc:1145] Deleting tablet e254839412ad42fcb6d2e22110d5ee24
0807 11:08:52.921411 (+ 53us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.429624 (+508213us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:53.966386 (+536762us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:54.023493 (+ 57107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":82633,"tablet-delete.queue_time_us":382781}
I20260807 11:08:54.066841 24262 ts_tablet_manager.cc:1397] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.011s
I20260807 11:08:54.067451 24593 tablet_replica.cc:330] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:54.067348 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet e254839412ad42fcb6d2e22110d5ee24 (table default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4 [id=ff1332012e264831adffc1c10a065f50]) successfully deleted
I20260807 11:08:54.068020 24604 raft_consensus.cc:482] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.068141 24593 raft_consensus.cc:2229] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:54.068476 23745 leader_election.cc:341] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.068612 24593 raft_consensus.cc:2258] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:54.068882 23745 leader_election.cc:302] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:54.068588 24604 raft_consensus.cc:504] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.069587 24756 raft_consensus.cc:2726] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.070573 24593 ts_tablet_manager.cc:1905] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:54.072630 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:54.069303 24262 raft_consensus.cc:348] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.076293 24262 raft_consensus.cc:374] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.076192 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655d379cab56486d872738de6acdffef" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:54.076530 24262 raft_consensus.cc:729] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.079438 24262 consensus_queue.cc:260] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.084810 24262 ts_tablet_manager.cc:1428] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20260807 11:08:54.085796 24262 tablet_bootstrap.cc:492] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:54.085739 23510 consensus_peers.cc:487] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:08:54.086426 23510 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.089105 24632 raft_consensus.cc:504] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:54.091379 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62eea967fed4adc84252b8366609878" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:54.100462 24262 tablet_bootstrap.cc:654] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.101374 24766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.252:40555 every 8 connection(s)
I20260807 11:08:54.101444 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_b208a091449545bb889b7ffb49a42e09" } new_table_name: "default.Table_cd586de57a6548dd85d7c3d40654cf90" modify_external_catalogs: true
I20260807 11:08:54.103668 24232 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.252:40555
I20260807 11:08:54.104875 23040 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_5764652d8e704dc8ac79eca55fcda6f7" } new_table_name: "default.Table_a7f137ab9e544641bdbf49dbee0a220e" modify_external_catalogs: true
I20260807 11:08:54.104863 24748 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260807 11:08:54.109102 24232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
I20260807 11:08:54.109901 24632 leader_election.cc:288] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:54.110271 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0071aac25afa4100b98c4811cf3e6b2e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:54.111058 23844 raft_consensus.cc:3037] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:54.113814 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 24232
W20260807 11:08:54.121944 23040 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ebf05f3933a433cb7201f6c1f9e11c9 has no consensus state
W20260807 11:08:54.128165 24762 log.cc:924] Time spent T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Append to log took a long time: real 0.053s user 0.000s sys 0.001s
I20260807 11:08:54.139581 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
W20260807 11:08:54.141063 23041 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64c4a0700315457384e3ca995de8a4f2 consensus state has no leader
I20260807 11:08:54.147002 23844 raft_consensus.cc:2454] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:54.148021 23036 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_2cbdc073cd0242d9ba358f06215755d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:54.148684 23507 leader_election.cc:302] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:08:54.149478 23036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cbdc073cd0242d9ba358f06215755d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.149618 24632 raft_consensus.cc:2781] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:54.150118 24632 raft_consensus.cc:686] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:54.151173 24632 consensus_queue.cc:237] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:54.159759 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0071aac25afa4100b98c4811cf3e6b2e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:54.162106 24756 raft_consensus.cc:482] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.162549 24756 raft_consensus.cc:504] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.164376 24756 leader_election.cc:288] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:54.165565 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ce7963b93094c27b9e25308e68be630" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:54.168051 23571 tablet_service.cc:1514] Processing DeleteTablet for tablet e254839412ad42fcb6d2e22110d5ee24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:54.168826 23745 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.172329 24262 tablet_bootstrap.cc:492] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:54.172775 24262 ts_tablet_manager.cc:1397] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.087s user 0.009s sys 0.029s
I20260807 11:08:54.173213 23803 tablet_service.cc:1514] Processing DeleteTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.175236 24262 raft_consensus.cc:348] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:54.175904 24262 raft_consensus.cc:374] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.176144 24262 raft_consensus.cc:729] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.176299 24057 raft_consensus.cc:3037] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:54.178171 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 655d379cab56486d872738de6acdffef with delete_type TABLET_DATA_DELETED (replaced by tablet 06a5e42d83ac4becb19a55d21040a3cc) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.178746 24262 consensus_queue.cc:260] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:54.179733 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet d5260c798aa645e5becf393f06528f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.179733 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ce7963b93094c27b9e25308e68be630" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:54.181512 24262 ts_tablet_manager.cc:1428] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 11:08:54.181913 23951 leader_election.cc:302] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:54.182339 24262 tablet_bootstrap.cc:492] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:54.183223 23510 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.183329 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0071aac25afa4100b98c4811cf3e6b2e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:54.184208 23510 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:54.185120 23510 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:54.186743 23745 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.187404 24261 tablet_bootstrap.cc:492] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:54.187814 24261 ts_tablet_manager.cc:1397] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.375s user 0.014s sys 0.004s
I20260807 11:08:54.187773 23745 leader_election.cc:302] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:54.189450 24756 raft_consensus.cc:2726] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.030397 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 112) took 1535 ms. Trace:
I20260807 11:08:54.193017 24506 rpcz_store.cc:276] 0807 11:08:52.494879 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.495083 (+ 204us) service_pool.cc:227] Handling call
0807 11:08:53.954983 (+1459900us) ts_tablet_manager.cc:1145] Deleting tablet 24d81c13089a44af8eb29400e0de721c
0807 11:08:53.955023 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:53.964468 (+ 9445us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:54.016472 (+ 52004us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:54.030343 (+ 13871us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1458740}
I20260807 11:08:54.195266 23571 tablet_service.cc:1514] Processing DeleteTablet for tablet 655d379cab56486d872738de6acdffef with delete_type TABLET_DATA_DELETED (replaced by tablet 06a5e42d83ac4becb19a55d21040a3cc) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.196880 24262 tablet_bootstrap.cc:654] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.203941 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 275ff54bfeae4fd3ad19e697a2b83e74
I20260807 11:08:54.207247 24262 tablet_bootstrap.cc:492] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:54.207755 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_30b02767d83b41a48e58f46544825d48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:54.207605 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 275ff54bfeae4fd3ad19e697a2b83e74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.209173 24262 ts_tablet_manager.cc:1397] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.000s
W20260807 11:08:54.209367 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30b02767d83b41a48e58f46544825d48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.209444 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_49cb17e7687c4e068540db74dfe3e793"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:54.210976 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49cb17e7687c4e068540db74dfe3e793 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.212456 24262 raft_consensus.cc:348] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.213092 24262 raft_consensus.cc:374] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.213342 24262 raft_consensus.cc:729] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.213562 23571 tablet_service.cc:1514] Processing DeleteTablet for tablet 275ff54bfeae4fd3ad19e697a2b83e74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.217901 24262 consensus_queue.cc:260] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.157896 24604 leader_election.cc:288] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:54.221426 24262 ts_tablet_manager.cc:1428] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260807 11:08:54.225478 24775 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260807 11:08:54.226109 23803 tablet_service.cc:1467] Processing CreateTablet for tablet aea90f7a10234f2da4fff089afe87a1e (DEFAULT_TABLE table=default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.222641 24604 raft_consensus.cc:2726] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.230238 23795 tablet_service.cc:1467] Processing CreateTablet for tablet e5685972a6dd45a3806f7a096bffd492 (DEFAULT_TABLE table=default.Table_89376166cd0b4be1ad5e90c84f809333 [id=44552a1ef4ac4136a8d4907501fc03ad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:54.232504 23951 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 50735.7us
I20260807 11:08:54.234498 23799 tablet_service.cc:1467] Processing CreateTablet for tablet 6a92aa4664c54114a8816710820e3864 (DEFAULT_TABLE table=default.Table_4ca9d06230fb4267b52ca061850a5169 [id=282f43d738714393ba1c23189d039355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.238173 24266 tablet_bootstrap.cc:654] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.246115 23581 tablet_service.cc:1467] Processing CreateTablet for tablet e5685972a6dd45a3806f7a096bffd492 (DEFAULT_TABLE table=default.Table_89376166cd0b4be1ad5e90c84f809333 [id=44552a1ef4ac4136a8d4907501fc03ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.247217 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 6a92aa4664c54114a8816710820e3864 (DEFAULT_TABLE table=default.Table_4ca9d06230fb4267b52ca061850a5169 [id=282f43d738714393ba1c23189d039355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.247388 24009 tablet_service.cc:1467] Processing CreateTablet for tablet aea90f7a10234f2da4fff089afe87a1e (DEFAULT_TABLE table=default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.247606 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5685972a6dd45a3806f7a096bffd492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.248471 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a92aa4664c54114a8816710820e3864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.248520 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aea90f7a10234f2da4fff089afe87a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.248739 23571 tablet_service.cc:1467] Processing CreateTablet for tablet aea90f7a10234f2da4fff089afe87a1e (DEFAULT_TABLE table=default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.249814 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aea90f7a10234f2da4fff089afe87a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.254735 24756 raft_consensus.cc:482] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.255268 24756 raft_consensus.cc:504] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.257670 24756 leader_election.cc:288] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:54.255700 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 275ff54bfeae4fd3ad19e697a2b83e74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:54.260109 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:54.261427 23745 leader_election.cc:341] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.262038 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:54.262537 24017 tablet_service.cc:1467] Processing CreateTablet for tablet e5685972a6dd45a3806f7a096bffd492 (DEFAULT_TABLE table=default.Table_89376166cd0b4be1ad5e90c84f809333 [id=44552a1ef4ac4136a8d4907501fc03ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.190435 24261 raft_consensus.cc:348] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
W20260807 11:08:54.263499 23745 leader_election.cc:341] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.263687 24261 raft_consensus.cc:374] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.263765 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5685972a6dd45a3806f7a096bffd492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.263958 24261 raft_consensus.cc:729] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.263908 23745 leader_election.cc:302] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:54.264566 24261 consensus_queue.cc:260] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:54.265326 24756 raft_consensus.cc:2726] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.266920 24261 ts_tablet_manager.cc:1428] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.079s user 0.007s sys 0.000s
I20260807 11:08:54.267771 24261 tablet_bootstrap.cc:492] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:54.270257 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_5d43d9d3c3a742dbb89c2d3827b71afd [id=f78c550f25a449ef9d47d66dd609e908]) successfully deleted
I20260807 11:08:54.278440 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5685972a6dd45a3806f7a096bffd492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.278705 24262 tablet_bootstrap.cc:492] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:54.279179 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a92aa4664c54114a8816710820e3864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.279482 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 115) took 1397 ms. Trace:
I20260807 11:08:54.279874 24506 rpcz_store.cc:276] 0807 11:08:52.882659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.882883 (+ 224us) service_pool.cc:227] Handling call
0807 11:08:54.193952 (+1311069us) ts_tablet_manager.cc:1145] Deleting tablet b3c9141f12804a96994994730996898b
0807 11:08:54.193999 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.279358 (+ 85359us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310444}
I20260807 11:08:54.280380 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aea90f7a10234f2da4fff089afe87a1e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:54.292456 23028 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 4e965a1dc66c414285df6727d2982e12 (table default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4e965a1dc66c414285df6727d2982e12 has no consensus state
I20260807 11:08:54.307101 24262 tablet_bootstrap.cc:654] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.308224 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 117) took 1408 ms. Trace:
I20260807 11:08:54.308620 24506 rpcz_store.cc:276] 0807 11:08:52.899911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.900550 (+ 639us) service_pool.cc:227] Handling call
0807 11:08:54.280840 (+1380290us) ts_tablet_manager.cc:1145] Deleting tablet b102e85fa1714a29afbc8302be47921e
0807 11:08:54.280884 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.308164 (+ 27280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1379652}
I20260807 11:08:54.310035 23035 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_9a56149cf3194cdf95b9d8ebb7565aee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:54.311636 23035 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a56149cf3194cdf95b9d8ebb7565aee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.325249 23046 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 6ce7963b93094c27b9e25308e68be630 (table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9]). Expected version 1 got 0
I20260807 11:08:54.325562 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_372ec524768f4c7e8b6914a92ab6d793" } new_table_name: "default.Table_25a3c70d458646fcaef373ad6e90dd75" modify_external_catalogs: true
I20260807 11:08:54.326256 23046 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
I20260807 11:08:54.327037 23046 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet dde5287f17a944708d7678c57bf37bf9 (table default.Table_a46f408876e040f7abc059e728d04a9c [id=d8165adfe8ce4053b5b35900f89cd0de]). Expected version 2 got 0
I20260807 11:08:54.328847 24506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40310 (request call id 119) took 1372 ms. Trace:
I20260807 11:08:54.329201 24506 rpcz_store.cc:276] 0807 11:08:52.956852 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.957023 (+ 171us) service_pool.cc:227] Handling call
0807 11:08:54.309529 (+1352506us) ts_tablet_manager.cc:1145] Deleting tablet cf445e8bf20b46f0831e218bb8eb3397
0807 11:08:54.309569 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.328774 (+ 19205us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1351653}
I20260807 11:08:54.334177 24748 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:52302 (request call id 113) took 1558 ms. Trace:
I20260807 11:08:54.334661 24748 rpcz_store.cc:276] 0807 11:08:52.775555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.778414 (+ 2859us) service_pool.cc:227] Handling call
0807 11:08:54.334053 (+1555639us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:52.955327 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0807 11:08:52.955668 (+ 341us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0807 11:08:52.955697 (+ 29us) alter_schema_op.cc:65] Acquired schema lock
0807 11:08:52.955771 (+ 74us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0807 11:08:52.955875 (+ 104us) alter_schema_op.cc:126] START. Timestamp: 1786100932955767
0807 11:08:52.955891 (+ 16us) op_driver.cc:331] REPLICATION: starting
0807 11:08:53.017972 (+ 62081us) log.cc:842] Serialized 173 byte log entry
0807 11:08:53.942222 (+924250us) op_driver.cc:444] REPLICATION: finished
0807 11:08:54.100567 (+158345us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0807 11:08:54.106928 (+ 6361us) log.cc:842] Serialized 5 byte log entry
0807 11:08:54.331383 (+224455us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:54.332716 (+ 1333us) log.cc:842] Serialized 14 byte log entry
0807 11:08:54.333896 (+ 1180us) alter_schema_op.cc:71] Released schema lock
0807 11:08:54.333920 (+ 24us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":156721,"mutex_wait_us":688798,"prepare.queue_time_us":1248,"prepare.run_cpu_time_us":7078,"prepare.run_wall_time_us":982430,"raft.queue_time_us":716431,"raft.run_cpu_time_us":1285,"raft.run_wall_time_us":1400,"replication_time_us":986148,"thread_start_us":368070,"threads_started":3,"wal-append.queue_time_us":54357,"wal-append.run_cpu_time_us":2546,"wal-append.run_wall_time_us":1010241}]]}
I20260807 11:08:54.312544 24777 tablet_replica.cc:330] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:54.340754 24007 tablet_service.cc:1467] Processing CreateTablet for tablet 6a92aa4664c54114a8816710820e3864 (DEFAULT_TABLE table=default.Table_4ca9d06230fb4267b52ca061850a5169 [id=282f43d738714393ba1c23189d039355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.341928 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a92aa4664c54114a8816710820e3864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.348789 23043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 84c78502f0a5485c9ffe4434c14567e0
W20260807 11:08:54.340418 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet b3c9141f12804a96994994730996898b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3c9141f12804a96994994730996898b already in progress: creating tablet
I20260807 11:08:54.330928 24604 raft_consensus.cc:482] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:08:54.352582 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet b102e85fa1714a29afbc8302be47921e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b102e85fa1714a29afbc8302be47921e already in progress: creating tablet
W20260807 11:08:54.353210 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet cf445e8bf20b46f0831e218bb8eb3397 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf445e8bf20b46f0831e218bb8eb3397 already in progress: creating tablet
W20260807 11:08:54.353789 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 1ce42b3bd73242418f510c5b83259238 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ce42b3bd73242418f510c5b83259238 already in progress: creating tablet
I20260807 11:08:54.355162 24018 tablet_service.cc:1514] Processing DeleteTablet for tablet 84c78502f0a5485c9ffe4434c14567e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:54.358922 24604 raft_consensus.cc:504] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:54.369508 23954 leader_election.cc:341] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:54.372155 24604 leader_election.cc:288] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:54.379490 24777 raft_consensus.cc:2229] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:54.383422 23045 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_c50eac50bd2e4bf0a0d23e39fa4bdbf3" } new_table_name: "default.Table_f343bd15113d474ba791135714036936" modify_external_catalogs: true
I20260807 11:08:54.390700 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 8a2df15b35bd435baaf95a708ec85a37
I20260807 11:08:54.392077 23042 catalog_manager.cc:6565] ReplaceTablet: tablet 8a2df15b35bd435baaf95a708ec85a37 deleted and replaced by tablet 39efd13118454aa983918238928ef2bc
I20260807 11:08:54.393107 23043 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
I20260807 11:08:54.403177 23797 tablet_service.cc:1514] Processing DeleteTablet for tablet 84c78502f0a5485c9ffe4434c14567e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.404012 24018 tablet_service.cc:1467] Processing CreateTablet for tablet f3647d1473454c9ca1c8c2d3441586a2 (DEFAULT_TABLE table=default.Table_bcbbbb7ddd0840a7b45baef6133d5808 [id=251656231af64a1b9a66dbbd7f962071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.405411 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3647d1473454c9ca1c8c2d3441586a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.409458 24011 tablet_service.cc:1467] Processing CreateTablet for tablet 2108b1d026bb42a88f95fef8badb1d77 (DEFAULT_TABLE table=default.Table_776b2db76b154e8b8bc73b21a93265eb [id=5c4a7629628b43dd940b6de0264cb7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.410672 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2108b1d026bb42a88f95fef8badb1d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.416529 23796 tablet_service.cc:1467] Processing CreateTablet for tablet f3647d1473454c9ca1c8c2d3441586a2 (DEFAULT_TABLE table=default.Table_bcbbbb7ddd0840a7b45baef6133d5808 [id=251656231af64a1b9a66dbbd7f962071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.416855 23802 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a2df15b35bd435baaf95a708ec85a37 with delete_type TABLET_DATA_DELETED (replaced by tablet 39efd13118454aa983918238928ef2bc) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.417765 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3647d1473454c9ca1c8c2d3441586a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.407235 24756 raft_consensus.cc:482] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.380082 24777 raft_consensus.cc:2258] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:54.419214 24756 raft_consensus.cc:504] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:54.421057 24777 ts_tablet_manager.cc:1905] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:54.421147 24756 leader_election.cc:288] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:54.403421 24368 raft_consensus.cc:482] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.423100 24368 raft_consensus.cc:504] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.424762 24368 leader_election.cc:288] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:54.422554 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 2108b1d026bb42a88f95fef8badb1d77 (DEFAULT_TABLE table=default.Table_776b2db76b154e8b8bc73b21a93265eb [id=5c4a7629628b43dd940b6de0264cb7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.435142 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2108b1d026bb42a88f95fef8badb1d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.383148 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 84c78502f0a5485c9ffe4434c14567e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:53 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.442946 23795 tablet_service.cc:1467] Processing CreateTablet for tablet c12bb5a459df41e0b0eb87534cb5959a (DEFAULT_TABLE table=default.Table_2b2b746a82f74eb287a03155c60fae3e [id=45a09889014c4159adfb72a6c32fc971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.444077 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c12bb5a459df41e0b0eb87534cb5959a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.452991 24262 tablet_bootstrap.cc:492] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:54.453456 24262 ts_tablet_manager.cc:1397] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.175s user 0.017s sys 0.011s
I20260807 11:08:54.458026 23581 tablet_service.cc:1514] Processing DeleteTablet for tablet 0071aac25afa4100b98c4811cf3e6b2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.402558 24593 ts_tablet_manager.cc:1918] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260807 11:08:54.409238 23571 tablet_service.cc:1467] Processing CreateTablet for tablet f3647d1473454c9ca1c8c2d3441586a2 (DEFAULT_TABLE table=default.Table_bcbbbb7ddd0840a7b45baef6133d5808 [id=251656231af64a1b9a66dbbd7f962071]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.416666 23572 tablet_service.cc:1467] Processing CreateTablet for tablet 2108b1d026bb42a88f95fef8badb1d77 (DEFAULT_TABLE table=default.Table_776b2db76b154e8b8bc73b21a93265eb [id=5c4a7629628b43dd940b6de0264cb7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.427205 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eaf45dad4a944dab77330db6fc53222" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:54.428049 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f6d2989e09466aaa374575a11f40e3" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:54.432379 24261 tablet_bootstrap.cc:654] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.463722 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3647d1473454c9ca1c8c2d3441586a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.464293 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2108b1d026bb42a88f95fef8badb1d77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:54.465020 23745 leader_election.cc:341] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:54.465648 23745 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.479177 24593 log.cc:1196] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/24d81c13089a44af8eb29400e0de721c
I20260807 11:08:54.480114 24593 ts_tablet_manager.cc:1939] T 24d81c13089a44af8eb29400e0de721c P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:54.480440 24262 raft_consensus.cc:348] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.481169 24262 raft_consensus.cc:374] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.481034 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 112) took 1977 ms. Trace:
I20260807 11:08:54.481423 24262 raft_consensus.cc:729] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.481561 24593 rpcz_store.cc:276] 0807 11:08:52.503821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:52.506975 (+ 3154us) service_pool.cc:227] Handling call
0807 11:08:54.067235 (+1560260us) ts_tablet_manager.cc:1145] Deleting tablet 24d81c13089a44af8eb29400e0de721c
0807 11:08:54.067323 (+ 88us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.121022 (+ 53699us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:54.402270 (+281248us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:54.480979 (+ 78709us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1559310}
I20260807 11:08:54.482112 24262 consensus_queue.cc:260] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.487044 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_5d43d9d3c3a742dbb89c2d3827b71afd" } modify_external_catalogs: true
I20260807 11:08:54.487555 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_5d43d9d3c3a742dbb89c2d3827b71afd" } modify_external_catalogs: true
W20260807 11:08:54.493801 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet f4f3bad2ba5e4178b29f52cfb53259db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f3bad2ba5e4178b29f52cfb53259db already in progress: creating tablet
W20260807 11:08:54.494449 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 275ff54bfeae4fd3ad19e697a2b83e74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 275ff54bfeae4fd3ad19e697a2b83e74 already in progress: creating tablet
I20260807 11:08:54.496304 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 24d81c13089a44af8eb29400e0de721c (table default.Table_5d43d9d3c3a742dbb89c2d3827b71afd [id=f78c550f25a449ef9d47d66dd609e908]) successfully deleted
I20260807 11:08:54.498828 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 116) took 1498 ms. Trace:
I20260807 11:08:54.498621 23563 tablet_service.cc:1467] Processing CreateTablet for tablet 907f602c4dce41389e06307270c16f71 (DEFAULT_TABLE table=default.Table_e4383b988f6941c9be5c4bbcc5425e76 [id=852d1ec4b63747218187fba2c75f2b87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.502702 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907f602c4dce41389e06307270c16f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.508842 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eaf45dad4a944dab77330db6fc53222" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:54.508921 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f6d2989e09466aaa374575a11f40e3" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:54.510629 24262 ts_tablet_manager.cc:1428] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.057s user 0.005s sys 0.000s
I20260807 11:08:54.511520 24262 tablet_bootstrap.cc:492] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:54.511462 23745 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.511937 23745 leader_election.cc:302] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:54.512656 24368 raft_consensus.cc:2726] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.515731 23796 tablet_service.cc:1467] Processing CreateTablet for tablet 907f602c4dce41389e06307270c16f71 (DEFAULT_TABLE table=default.Table_e4383b988f6941c9be5c4bbcc5425e76 [id=852d1ec4b63747218187fba2c75f2b87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.516830 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907f602c4dce41389e06307270c16f71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:54.524052 23745 leader_election.cc:341] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.524449 23745 leader_election.cc:302] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:54.525311 24368 raft_consensus.cc:2726] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.529063 23581 tablet_service.cc:1467] Processing CreateTablet for tablet c12bb5a459df41e0b0eb87534cb5959a (DEFAULT_TABLE table=default.Table_2b2b746a82f74eb287a03155c60fae3e [id=45a09889014c4159adfb72a6c32fc971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.530167 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c12bb5a459df41e0b0eb87534cb5959a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.532472 24771 sys_catalog.cc:263] Verifying existing consensus state
I20260807 11:08:54.533552 23583 tablet_service.cc:1467] Processing CreateTablet for tablet 6a427e865f1c4d938483a8222a95307e (DEFAULT_TABLE table=default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:54.533990 23951 leader_election.cc:341] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:54.534366 23951 leader_election.cc:302] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:54.534541 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a427e865f1c4d938483a8222a95307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.536006 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a2df15b35bd435baaf95a708ec85a37 with delete_type TABLET_DATA_DELETED (replaced by tablet 39efd13118454aa983918238928ef2bc) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:54.536842 23041 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
I20260807 11:08:54.542222 24008 tablet_service.cc:1467] Processing CreateTablet for tablet 6a427e865f1c4d938483a8222a95307e (DEFAULT_TABLE table=default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.543290 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a427e865f1c4d938483a8222a95307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.546836 24013 tablet_service.cc:1467] Processing CreateTablet for tablet c12bb5a459df41e0b0eb87534cb5959a (DEFAULT_TABLE table=default.Table_2b2b746a82f74eb287a03155c60fae3e [id=45a09889014c4159adfb72a6c32fc971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.547844 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c12bb5a459df41e0b0eb87534cb5959a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.552657 24262 tablet_bootstrap.cc:654] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.556433 24266 tablet_bootstrap.cc:492] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:54.556813 24266 ts_tablet_manager.cc:1397] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.542s user 0.011s sys 0.005s
I20260807 11:08:54.559656 24266 raft_consensus.cc:348] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.560288 24266 raft_consensus.cc:374] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.560524 24266 raft_consensus.cc:729] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.561156 24266 consensus_queue.cc:260] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.537937 24604 raft_consensus.cc:2726] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.563558 24266 ts_tablet_manager.cc:1428] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 11:08:54.564343 24266 tablet_bootstrap.cc:492] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:54.567447 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 907f602c4dce41389e06307270c16f71 (DEFAULT_TABLE table=default.Table_e4383b988f6941c9be5c4bbcc5425e76 [id=852d1ec4b63747218187fba2c75f2b87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.568459 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907f602c4dce41389e06307270c16f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.499169 24593 rpcz_store.cc:276] 0807 11:08:53.000005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:53.027104 (+ 27099us) service_pool.cc:227] Handling call
0807 11:08:54.498396 (+1471292us) ts_tablet_manager.cc:1145] Deleting tablet b3c9141f12804a96994994730996898b
0807 11:08:54.498463 (+ 67us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.498761 (+ 298us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1470704}
I20260807 11:08:54.574743 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 118) took 1519 ms. Trace:
I20260807 11:08:54.575122 24593 rpcz_store.cc:276] 0807 11:08:53.055605 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:53.074484 (+ 18879us) service_pool.cc:227] Handling call
0807 11:08:54.574274 (+1499790us) ts_tablet_manager.cc:1145] Deleting tablet b102e85fa1714a29afbc8302be47921e
0807 11:08:54.574337 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.574679 (+ 342us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1499194}
I20260807 11:08:54.576797 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 120) took 1477 ms. Trace:
I20260807 11:08:54.589680 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 6a427e865f1c4d938483a8222a95307e (DEFAULT_TABLE table=default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.590827 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a427e865f1c4d938483a8222a95307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.595781 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_bfdb65009c1f4abebd979f0ebc8d41d5" } modify_external_catalogs: true
I20260807 11:08:54.596164 24262 tablet_bootstrap.cc:492] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:54.596299 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_bfdb65009c1f4abebd979f0ebc8d41d5" } modify_external_catalogs: true
I20260807 11:08:54.596553 24262 ts_tablet_manager.cc:1397] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.085s user 0.008s sys 0.000s
W20260807 11:08:54.597107 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet b3c9141f12804a96994994730996898b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3c9141f12804a96994994730996898b already in progress: creating tablet
W20260807 11:08:54.597699 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet b102e85fa1714a29afbc8302be47921e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b102e85fa1714a29afbc8302be47921e already in progress: creating tablet
W20260807 11:08:54.598443 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 84c78502f0a5485c9ffe4434c14567e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84c78502f0a5485c9ffe4434c14567e0 already in progress: creating tablet
I20260807 11:08:54.600056 24019 tablet_service.cc:1467] Processing CreateTablet for tablet e7aa352ec3434afb81933c3151c3742d (DEFAULT_TABLE table=default.Table_c8e7c102b5df4cc6ac8958d6250ef4e6 [id=81710632f4754a50bbf43e0cd8d80296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.601200 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7aa352ec3434afb81933c3151c3742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.598706 24262 raft_consensus.cc:348] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:54.607414 24262 raft_consensus.cc:374] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 11:08:54.607528 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3011806841f46f898920b1a11404f85 has no consensus state
I20260807 11:08:54.607672 24262 raft_consensus.cc:729] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.608505 23046 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: default.Table_068a29afd43d4b3389b7c2f992abf956 [id=97fa5c597042473aac2865ebebf63541] alter complete (version 2)
I20260807 11:08:54.610570 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet 10f6d2989e09466aaa374575a11f40e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.611334 23797 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ac76be04eca4d7d9d7f0cf6956fd56a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:51 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.611363 23799 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eaf45dad4a944dab77330db6fc53222 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4a0700315457384e3ca995de8a4f2) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.612515 24771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Bootstrap starting.
W20260807 11:08:54.614254 23045 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cef5bc28dada49bdada085e87d1f0dab consensus state has no leader
I20260807 11:08:54.595376 23041 master_service.cc:946] ReplaceTablet: received request to replace tablet 6ce7963b93094c27b9e25308e68be630 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:54.618901 24012 tablet_service.cc:1514] Processing DeleteTablet for tablet e254839412ad42fcb6d2e22110d5ee24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:54.620224 24012 tablet_service.cc:1514] Processing DeleteTablet for tablet cdaf60bc130e4a84b7a309eec3109d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:47 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:54.627791 23913 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:54.630756 24506 tablet_replica.cc:330] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:54.632454 24506 raft_consensus.cc:2229] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:54.637002 23797 tablet_service.cc:1467] Processing CreateTablet for tablet 4b001bc080a14838a3fc58af982b792b (DEFAULT_TABLE table=default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.637074 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 11c31c37cb2a4d1d8396a79de7d2493c (DEFAULT_TABLE table=default.Table_07911aa3b4c244118be60ebcc25a777a [id=e2e06aca451241a2b4d4c84ccabfc1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.638805 23799 tablet_service.cc:1467] Processing CreateTablet for tablet e7aa352ec3434afb81933c3151c3742d (DEFAULT_TABLE table=default.Table_c8e7c102b5df4cc6ac8958d6250ef4e6 [id=81710632f4754a50bbf43e0cd8d80296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.639545 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b001bc080a14838a3fc58af982b792b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.640331 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7aa352ec3434afb81933c3151c3742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.641388 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c31c37cb2a4d1d8396a79de7d2493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.642820 23570 tablet_service.cc:1467] Processing CreateTablet for tablet e7aa352ec3434afb81933c3151c3742d (DEFAULT_TABLE table=default.Table_c8e7c102b5df4cc6ac8958d6250ef4e6 [id=81710632f4754a50bbf43e0cd8d80296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.644150 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7aa352ec3434afb81933c3151c3742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.656903 24506 raft_consensus.cc:2258] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:54.658588 24506 ts_tablet_manager.cc:1905] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:54.665213 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a2df15b35bd435baaf95a708ec85a37 with delete_type TABLET_DATA_DELETED (replaced by tablet 39efd13118454aa983918238928ef2bc) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.665513 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 4b001bc080a14838a3fc58af982b792b (DEFAULT_TABLE table=default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.666744 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b001bc080a14838a3fc58af982b792b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.666898 23571 tablet_service.cc:1514] Processing DeleteTablet for tablet 069c0bb933ce4d29976205e0286071eb with delete_type TABLET_DATA_DELETED (replaced by tablet fb1504be4320471687d86a55a9891081) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.674010 23691 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:54.678470 24262 consensus_queue.cc:260] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:54.680665 24262 ts_tablet_manager.cc:1428] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.084s user 0.006s sys 0.000s
I20260807 11:08:54.710120 23802 tablet_service.cc:1467] Processing CreateTablet for tablet 26e0c103c9724de18cf95897f33a101a (DEFAULT_TABLE table=default.Table_5d43d9d3c3a742dbb89c2d3827b71afd [id=f78c550f25a449ef9d47d66dd609e908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.577131 24593 rpcz_store.cc:276] 0807 11:08:53.099328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:53.211036 (+111708us) service_pool.cc:227] Handling call
0807 11:08:54.576204 (+1365168us) ts_tablet_manager.cc:1145] Deleting tablet cf445e8bf20b46f0831e218bb8eb3397
0807 11:08:54.576351 (+ 147us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.576736 (+ 385us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364523}
I20260807 11:08:54.719817 24632 raft_consensus.cc:482] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.720799 24261 tablet_bootstrap.cc:492] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:54.720384 24632 raft_consensus.cc:504] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:54.721179 24261 ts_tablet_manager.cc:1397] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.454s user 0.043s sys 0.028s
W20260807 11:08:54.722729 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 8a2df15b35bd435baaf95a708ec85a37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a2df15b35bd435baaf95a708ec85a37 already in progress: creating tablet
W20260807 11:08:54.724547 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet cf445e8bf20b46f0831e218bb8eb3397 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf445e8bf20b46f0831e218bb8eb3397 already in progress: creating tablet
I20260807 11:08:54.725412 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 26e0c103c9724de18cf95897f33a101a (DEFAULT_TABLE table=default.Table_5d43d9d3c3a742dbb89c2d3827b71afd [id=f78c550f25a449ef9d47d66dd609e908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.726369 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26e0c103c9724de18cf95897f33a101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.726792 24632 leader_election.cc:288] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:54.727041 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26e0c103c9724de18cf95897f33a101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.728778 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "069c0bb933ce4d29976205e0286071eb" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:54.729907 24593 tablet_replica.cc:330] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:54.730639 23571 tablet_service.cc:1467] Processing CreateTablet for tablet 11c31c37cb2a4d1d8396a79de7d2493c (DEFAULT_TABLE table=default.Table_07911aa3b4c244118be60ebcc25a777a [id=e2e06aca451241a2b4d4c84ccabfc1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.731104 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 26e0c103c9724de18cf95897f33a101a (DEFAULT_TABLE table=default.Table_5d43d9d3c3a742dbb89c2d3827b71afd [id=f78c550f25a449ef9d47d66dd609e908]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.727770 24261 raft_consensus.cc:348] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:54.732086 24261 raft_consensus.cc:374] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.724191 24009 tablet_service.cc:1467] Processing CreateTablet for tablet 4b001bc080a14838a3fc58af982b792b (DEFAULT_TABLE table=default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.732326 24261 raft_consensus.cc:729] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.732893 24261 consensus_queue.cc:260] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:54.735519 24262 tablet_bootstrap.cc:492] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:54.738692 23510 leader_election.cc:341] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:54.739527 23507 leader_election.cc:341] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 069c0bb933ce4d29976205e0286071eb
I20260807 11:08:54.739872 23507 leader_election.cc:302] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:54.739426 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b001bc080a14838a3fc58af982b792b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.740895 24734 raft_consensus.cc:2726] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.731179 24593 raft_consensus.cc:2229] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:54.742274 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c31c37cb2a4d1d8396a79de7d2493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.743157 24593 pending_rounds.cc:62] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Trying to abort 1 pending ops.
I20260807 11:08:54.743456 24593 pending_rounds.cc:68] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869419888185344 op_type: NO_OP noop_request { }
I20260807 11:08:54.743994 24593 raft_consensus.cc:2866] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:54.744431 24593 raft_consensus.cc:2258] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:54.747162 24593 ts_tablet_manager.cc:1905] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:54.756670 24261 ts_tablet_manager.cc:1428] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260807 11:08:54.757613 24261 tablet_bootstrap.cc:492] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:54.758073 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 11c31c37cb2a4d1d8396a79de7d2493c (DEFAULT_TABLE table=default.Table_07911aa3b4c244118be60ebcc25a777a [id=e2e06aca451241a2b4d4c84ccabfc1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:54.759258 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c31c37cb2a4d1d8396a79de7d2493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.786718 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26e0c103c9724de18cf95897f33a101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:54.793743 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 26e0c103c9724de18cf95897f33a101a
I20260807 11:08:54.795217 24262 tablet_bootstrap.cc:654] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.797859 24055 raft_consensus.cc:3037] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:54.800649 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 75518.7us
I20260807 11:08:54.803400 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_df4c28e5effb4b60b90f040c46268eb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:54.804862 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df4c28e5effb4b60b90f040c46268eb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.807443 24119 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:54.808104 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:54.810449 23799 tablet_service.cc:1514] Processing DeleteTablet for tablet 26e0c103c9724de18cf95897f33a101a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:54 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.822992 24734 raft_consensus.cc:482] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.823575 24734 raft_consensus.cc:504] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:54.826421 24734 leader_election.cc:288] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:54.828066 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_4c5d794da7e44ab3930228c578241301"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:54.828495 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b102e85fa1714a29afbc8302be47921e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:54.829557 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c5d794da7e44ab3930228c578241301 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:54.830761 23507 leader_election.cc:341] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: b102e85fa1714a29afbc8302be47921e
W20260807 11:08:54.831686 23510 leader_election.cc:341] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:54.832187 23510 leader_election.cc:302] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:54.833541 24632 raft_consensus.cc:2726] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.839666 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_f7407267f0e140289ed791ad730d154f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:54.841280 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7407267f0e140289ed791ad730d154f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.702657 24266 tablet_bootstrap.cc:654] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.851544 24777 ts_tablet_manager.cc:1918] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:54.852125 24777 log.cc:1196] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:08:54.853550 23043 master_service.cc:946] ReplaceTablet: received request to replace tablet 7a7ccf34faf345998028f67921927f0e from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:54.854228 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4ca9d06230fb4267b52ca061850a5169" } new_table_name: "default.Table_1ba07f688e5f42a18c6985eaf65e16e1" modify_external_catalogs: true
I20260807 11:08:54.855726 23036 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_7c48f335b7db49d3ac516531dcda4561" } new_table_name: "default.Table_3d3d2c64ef784197815a34510666c5df" modify_external_catalogs: true
I20260807 11:08:54.857053 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_a3e64f9fd57b414297e097d0343fb164"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:54.858469 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3e64f9fd57b414297e097d0343fb164 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:54.888188 23570 tablet_service.cc:1514] Processing DeleteTablet for tablet 26e0c103c9724de18cf95897f33a101a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:54 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.889868 23570 tablet_service.cc:1514] Processing DeleteTablet for tablet b102e85fa1714a29afbc8302be47921e with delete_type TABLET_DATA_DELETED (replaced by tablet 6a427e865f1c4d938483a8222a95307e) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.899363 24777 ts_tablet_manager.cc:1939] T 0071aac25afa4100b98c4811cf3e6b2e P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:54.903038 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 0071aac25afa4100b98c4811cf3e6b2e (table default.Table_980e69ceeabe4770af78e53803d0bf9a [id=2353f55fa7e149748a100664634353bb]) successfully deleted
I20260807 11:08:54.905496 24261 tablet_bootstrap.cc:654] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:54.909587 24604 raft_consensus.cc:482] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:54.909770 24777 tablet_replica.cc:330] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
W20260807 11:08:54.914122 23745 consensus_peers.cc:487] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:54.910166 24604 raft_consensus.cc:504] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.917912 24604 leader_election.cc:288] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:54.920720 23954 leader_election.cc:341] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: cdaf60bc130e4a84b7a309eec3109d61
I20260807 11:08:54.921046 24729 consensus_queue.cc:1035] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 11:08:54.922969 23951 leader_election.cc:341] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: cdaf60bc130e4a84b7a309eec3109d61
I20260807 11:08:54.923355 23951 leader_election.cc:302] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:54.924436 24604 raft_consensus.cc:2726] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:54.915854 24011 tablet_service.cc:1514] Processing DeleteTablet for tablet 26e0c103c9724de18cf95897f33a101a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:54 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:54.937889 24506 ts_tablet_manager.cc:1918] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:54.938361 24506 log.cc:1196] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:54.939046 24506 ts_tablet_manager.cc:1939] T e254839412ad42fcb6d2e22110d5ee24 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:54.947824 23040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet d78ed82613064935919934df7124d707
W20260807 11:08:54.948930 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 55682.6us
I20260807 11:08:54.949859 23041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 6ce7963b93094c27b9e25308e68be630
I20260807 11:08:54.951382 23570 tablet_service.cc:1514] Processing DeleteTablet for tablet d78ed82613064935919934df7124d707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:54 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:54.954936 23041 catalog_manager.cc:6565] ReplaceTablet: tablet 6ce7963b93094c27b9e25308e68be630 deleted and replaced by tablet 94fa4bb0de684c50bcba33519866e583
I20260807 11:08:54.960810 23807 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ce7963b93094c27b9e25308e68be630 with delete_type TABLET_DATA_DELETED (replaced by tablet 94fa4bb0de684c50bcba33519866e583) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.961952 23802 tablet_service.cc:1514] Processing DeleteTablet for tablet d78ed82613064935919934df7124d707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:54 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:54.974929 24266 tablet_bootstrap.cc:492] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:54.975411 24266 ts_tablet_manager.cc:1397] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.411s user 0.009s sys 0.009s
I20260807 11:08:54.978816 24266 raft_consensus.cc:348] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:54.982023 24266 raft_consensus.cc:374] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:54.982278 24266 raft_consensus.cc:729] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:54.979962 24506 tablet_replica.cc:330] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:54.991083 23041 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
I20260807 11:08:54.987715 24266 consensus_queue.cc:260] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:55.006466 23040 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_c3485c1fbb944ca29c99d5da8d146c32 [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 1 got 0
I20260807 11:08:55.007124 24506 raft_consensus.cc:2229] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:55.007534 24506 raft_consensus.cc:2258] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:55.010627 24506 ts_tablet_manager.cc:1905] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:55.010919 24262 tablet_bootstrap.cc:492] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:55.011350 24262 ts_tablet_manager.cc:1397] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.276s user 0.010s sys 0.005s
I20260807 11:08:55.013525 24262 raft_consensus.cc:348] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.014147 24262 raft_consensus.cc:374] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:55.014392 24262 raft_consensus.cc:729] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:55.026783 24506 ts_tablet_manager.cc:1918] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:55.027227 24506 log.cc:1196] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/cdaf60bc130e4a84b7a309eec3109d61
I20260807 11:08:55.029825 24011 tablet_service.cc:1514] Processing DeleteTablet for tablet d78ed82613064935919934df7124d707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:54 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:54.911108 24777 raft_consensus.cc:2229] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:55.032959 24777 raft_consensus.cc:2258] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:55.035073 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet e254839412ad42fcb6d2e22110d5ee24 (table default.Table_4f5eedc690dd4f478a0386b2e3a2b1f4 [id=ff1332012e264831adffc1c10a065f50]) successfully deleted
I20260807 11:08:55.035799 24506 ts_tablet_manager.cc:1939] T cdaf60bc130e4a84b7a309eec3109d61 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:55.037168 24266 ts_tablet_manager.cc:1428] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.061s user 0.003s sys 0.005s
I20260807 11:08:55.039095 24011 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ce7963b93094c27b9e25308e68be630 with delete_type TABLET_DATA_DELETED (replaced by tablet 94fa4bb0de684c50bcba33519866e583) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.039651 24368 raft_consensus.cc:482] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.040060 24368 raft_consensus.cc:504] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:55.040382 24011 tablet_service.cc:1514] Processing DeleteTablet for tablet 555f31aac90945f8b8a53396a9dbbe4b with delete_type TABLET_DATA_DELETED (replaced by tablet cc48c13644a3401ab34dad398a7f5cd5) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.042158 24368 leader_election.cc:288] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:55.045367 24368 raft_consensus.cc:482] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.045759 24368 raft_consensus.cc:504] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:55.046712 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738da1d000b4434cb194d91fea4cc6a5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:55.047521 24368 leader_election.cc:288] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:55.041563 24771 log.cc:824] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Log is configured to *not* fsync() on all Append() calls
I20260807 11:08:55.051007 24266 tablet_bootstrap.cc:492] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:08:55.051307 23036 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a20f0ba778a14d71b9e5efa113c784ff consensus state has no leader
I20260807 11:08:55.052301 24506 tablet_replica.cc:330] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:55.056887 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738da1d000b4434cb194d91fea4cc6a5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:55.057337 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:55.058624 23570 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ce7963b93094c27b9e25308e68be630 with delete_type TABLET_DATA_DELETED (replaced by tablet 94fa4bb0de684c50bcba33519866e583) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:55.059841 23745 leader_election.cc:341] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:55.064978 23745 leader_election.cc:341] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.065331 23745 leader_election.cc:302] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.065828 24777 ts_tablet_manager.cc:1905] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:08:55.066262 23745 leader_election.cc:341] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.066463 24368 raft_consensus.cc:2726] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:08:55.073504 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a92aa4664c54114a8816710820e3864 consensus state has no leader
I20260807 11:08:55.076848 23802 tablet_service.cc:1514] Processing DeleteTablet for tablet 64cb221021564d66bfecf5cd91bcec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:55.084147 23043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 7a7ccf34faf345998028f67921927f0e
I20260807 11:08:55.085551 23043 catalog_manager.cc:6565] ReplaceTablet: tablet 7a7ccf34faf345998028f67921927f0e deleted and replaced by tablet eb6981fd8c9d4d4d8606fc73f7a01d0b
I20260807 11:08:55.091246 23803 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a7ccf34faf345998028f67921927f0e with delete_type TABLET_DATA_DELETED (replaced by tablet eb6981fd8c9d4d4d8606fc73f7a01d0b) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:55.093518 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet cdaf60bc130e4a84b7a309eec3109d61 (table default.Table_a536193b9fc2446c9cfad81487d26c97 [id=32b96b2f0b644d94aa4ae5432d615506]) successfully deleted
I20260807 11:08:55.094045 24262 consensus_queue.cc:260] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.053167 24506 raft_consensus.cc:2229] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:55.115597 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 26e0c103c9724de18cf95897f33a101a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26e0c103c9724de18cf95897f33a101a already in progress: creating tablet
I20260807 11:08:55.127416 24506 raft_consensus.cc:2258] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
W20260807 11:08:55.127801 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet d78ed82613064935919934df7124d707 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d78ed82613064935919934df7124d707 already in progress: creating tablet
W20260807 11:08:55.128343 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 6ce7963b93094c27b9e25308e68be630 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ce7963b93094c27b9e25308e68be630 already in progress: creating tablet
I20260807 11:08:55.131482 24262 ts_tablet_manager.cc:1428] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.120s user 0.006s sys 0.000s
I20260807 11:08:55.135149 24262 tablet_bootstrap.cc:492] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:55.140125 24593 ts_tablet_manager.cc:1918] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:55.142336 24262 tablet_bootstrap.cc:654] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:55.144146 24593 log.cc:1196] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/555f31aac90945f8b8a53396a9dbbe4b
I20260807 11:08:55.140719 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a7ccf34faf345998028f67921927f0e with delete_type TABLET_DATA_DELETED (replaced by tablet eb6981fd8c9d4d4d8606fc73f7a01d0b) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:55.146430 24593 ts_tablet_manager.cc:1939] T 555f31aac90945f8b8a53396a9dbbe4b P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:55.149168 23043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_dfc7836ffc654981bb422bfcb80486bc" } modify_external_catalogs: true
I20260807 11:08:55.149688 23043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_dfc7836ffc654981bb422bfcb80486bc" } modify_external_catalogs: true
I20260807 11:08:55.060443 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:55.166945 24011 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a7ccf34faf345998028f67921927f0e with delete_type TABLET_DATA_DELETED (replaced by tablet eb6981fd8c9d4d4d8606fc73f7a01d0b) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.168277 24777 ts_tablet_manager.cc:1918] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:55.168737 24777 log.cc:1196] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/655d379cab56486d872738de6acdffef
I20260807 11:08:55.169480 24777 ts_tablet_manager.cc:1939] T 655d379cab56486d872738de6acdffef P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:55.172248 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 655d379cab56486d872738de6acdffef (table default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]) successfully deleted
W20260807 11:08:55.172501 23745 leader_election.cc:341] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.172819 23745 leader_election.cc:302] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.173266 24777 tablet_replica.cc:330] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:55.173580 24506 ts_tablet_manager.cc:1905] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:55.174024 24729 raft_consensus.cc:2726] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:55.174180 24777 raft_consensus.cc:2229] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:55.175168 24777 raft_consensus.cc:2258] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:55.176450 24266 tablet_bootstrap.cc:654] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:55.178534 24262 tablet_bootstrap.cc:492] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:55.178995 24262 ts_tablet_manager.cc:1397] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.000s
I20260807 11:08:55.164566 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 127) took 1381 ms. Trace:
I20260807 11:08:55.181403 24262 raft_consensus.cc:348] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.182052 24262 raft_consensus.cc:374] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:55.182299 24262 raft_consensus.cc:729] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:55.182964 24262 consensus_queue.cc:260] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.181443 24593 rpcz_store.cc:276] 0807 11:08:53.783303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:53.783425 (+ 122us) service_pool.cc:227] Handling call
0807 11:08:54.719035 (+935610us) ts_tablet_manager.cc:1145] Deleting tablet 555f31aac90945f8b8a53396a9dbbe4b
0807 11:08:54.721740 (+ 2705us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:54.911614 (+189874us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:55.139860 (+228246us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:55.164498 (+ 24638us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":934809}
I20260807 11:08:55.188144 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 555f31aac90945f8b8a53396a9dbbe4b (table default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]) successfully deleted
I20260807 11:08:55.189666 24261 tablet_bootstrap.cc:492] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:55.190164 24261 ts_tablet_manager.cc:1397] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.433s user 0.005s sys 0.012s
I20260807 11:08:55.192551 24261 raft_consensus.cc:348] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:55.193322 24777 ts_tablet_manager.cc:1905] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:55.199072 24261 raft_consensus.cc:374] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:55.199373 24261 raft_consensus.cc:729] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:55.200203 24261 consensus_queue.cc:260] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:55.201421 24262 ts_tablet_manager.cc:1428] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260807 11:08:55.193568 24593 tablet_replica.cc:330] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:55.206331 24262 tablet_bootstrap.cc:492] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:55.214227 24262 tablet_bootstrap.cc:654] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:55.223775 24368 raft_consensus.cc:482] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.224215 24368 raft_consensus.cc:504] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.225683 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:55.226148 24368 leader_election.cc:288] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:55.228995 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:48 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:55.230273 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cb221021564d66bfecf5cd91bcec5c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:55.232347 23745 leader_election.cc:341] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.233042 23045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_2b2b746a82f74eb287a03155c60fae3e" } modify_external_catalogs: true
I20260807 11:08:55.233626 23045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_2b2b746a82f74eb287a03155c60fae3e" } modify_external_catalogs: true
I20260807 11:08:55.233757 24368 raft_consensus.cc:482] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.234184 24368 raft_consensus.cc:504] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:55.236423 24593 raft_consensus.cc:2229] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:55.237320 24593 raft_consensus.cc:2258] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:55.240155 24593 ts_tablet_manager.cc:1905] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:55.244498 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2df15b35bd435baaf95a708ec85a37" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:55.251132 23745 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.251760 24368 leader_election.cc:288] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:55.267390 24011 tablet_service.cc:1467] Processing CreateTablet for tablet cdd1a829d01c41f28a54cf4e3d9c3099 (DEFAULT_TABLE table=default.Table_9a56149cf3194cdf95b9d8ebb7565aee [id=0c35da9831c64205922aa00f91d5b80d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.267867 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_94689d0c00964dc88800aa0602ac5f73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:55.268754 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd1a829d01c41f28a54cf4e3d9c3099. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:55.269371 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94689d0c00964dc88800aa0602ac5f73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:55.271466 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (DEFAULT_TABLE table=default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.272363 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebf05f3933a433cb7201f6c1f9e11c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.277421 23803 tablet_service.cc:1467] Processing CreateTablet for tablet cdd1a829d01c41f28a54cf4e3d9c3099 (DEFAULT_TABLE table=default.Table_9a56149cf3194cdf95b9d8ebb7565aee [id=0c35da9831c64205922aa00f91d5b80d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.280095 23802 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (DEFAULT_TABLE table=default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.244263 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cb221021564d66bfecf5cd91bcec5c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:55.283178 23745 leader_election.cc:341] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.283589 23745 leader_election.cc:302] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.284888 24368 raft_consensus.cc:2726] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:55.285188 24266 tablet_bootstrap.cc:492] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:55.247399 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2df15b35bd435baaf95a708ec85a37" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:55.263430 23510 consensus_peers.cc:487] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:55.285699 24266 ts_tablet_manager.cc:1397] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.235s user 0.007s sys 0.004s
I20260807 11:08:55.266250 23580 tablet_service.cc:1467] Processing CreateTablet for tablet cdd1a829d01c41f28a54cf4e3d9c3099 (DEFAULT_TABLE table=default.Table_9a56149cf3194cdf95b9d8ebb7565aee [id=0c35da9831c64205922aa00f91d5b80d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.286778 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd1a829d01c41f28a54cf4e3d9c3099. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:55.287751 23745 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.288138 23745 leader_election.cc:302] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.288395 24266 raft_consensus.cc:348] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:55.289120 24266 raft_consensus.cc:374] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:55.288875 23807 tablet_service.cc:1467] Processing CreateTablet for tablet c5dfdf237bab4aefbd1a45325d741cf5 (DEFAULT_TABLE table=default.Table_3296c53524e341ea9bd1f69a41aec0c4 [id=00906552217a443386552aeb9a487abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.268551 23571 tablet_service.cc:1467] Processing CreateTablet for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (DEFAULT_TABLE table=default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.291290 23570 tablet_service.cc:1467] Processing CreateTablet for tablet c5dfdf237bab4aefbd1a45325d741cf5 (DEFAULT_TABLE table=default.Table_3296c53524e341ea9bd1f69a41aec0c4 [id=00906552217a443386552aeb9a487abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.291817 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebf05f3933a433cb7201f6c1f9e11c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.291678 24009 tablet_service.cc:1467] Processing CreateTablet for tablet c5dfdf237bab4aefbd1a45325d741cf5 (DEFAULT_TABLE table=default.Table_3296c53524e341ea9bd1f69a41aec0c4 [id=00906552217a443386552aeb9a487abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.292492 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5dfdf237bab4aefbd1a45325d741cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.293001 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5dfdf237bab4aefbd1a45325d741cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.295253 23048 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_a3e64f9fd57b414297e097d0343fb164" } new_table_name: "default.Table_308433d482ea452289ce2b3d63e5577d" modify_external_catalogs: true
I20260807 11:08:55.295660 24368 raft_consensus.cc:2726] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:55.276149 24261 ts_tablet_manager.cc:1428] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.086s user 0.000s sys 0.004s
I20260807 11:08:55.300943 23042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_81cea7b24eb8462093613254c16693bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:55.302435 23042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81cea7b24eb8462093613254c16693bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:55.303197 23507 consensus_peers.cc:487] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 655d379cab56486d872738de6acdffef. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:55.306609 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd1a829d01c41f28a54cf4e3d9c3099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.308014 24261 tablet_bootstrap.cc:492] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:55.311808 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_8aada9f80c114120b9fad92d59976579"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:55.313175 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aada9f80c114120b9fad92d59976579 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:55.316803 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5dfdf237bab4aefbd1a45325d741cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.324685 23043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 573b681662bc409aa36ccc65e14e9841
W20260807 11:08:55.326102 23510 consensus_peers.cc:487] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:55.324821 23799 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fb920ddfaaa423387c98112b52fc2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:49 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:55.326735 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ebf05f3933a433cb7201f6c1f9e11c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.328159 23799 tablet_service.cc:1514] Processing DeleteTablet for tablet 573b681662bc409aa36ccc65e14e9841 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:55.341001 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 573b681662bc409aa36ccc65e14e9841 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.343704 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 573b681662bc409aa36ccc65e14e9841 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:55.351222 23799 tablet_service.cc:1467] Processing CreateTablet for tablet af30e8f4acfb48db875017c1db21f433 (DEFAULT_TABLE table=default.Table_9b7a6afec0d2423ea15d59b70e646e8d [id=9d1d8cf406384f4291a4f52655394cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.289345 24266 raft_consensus.cc:729] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:55.352602 24266 consensus_queue.cc:260] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:55.359465 23043 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_68575b95a3f045c989a91bff8785baed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:55.362143 23043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68575b95a3f045c989a91bff8785baed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:08:55.365463 23030 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6ce7963b93094c27b9e25308e68be630 (table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ce7963b93094c27b9e25308e68be630 consensus state has no leader
I20260807 11:08:55.366149 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 24f87bb654c84064b7bc26864ceb9755 (DEFAULT_TABLE table=default.Table_1e2e0850d0394751b215be889b722ade [id=8cb8accd8f7b4559824a1643fd9c100f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.367863 23572 tablet_service.cc:1467] Processing CreateTablet for tablet af30e8f4acfb48db875017c1db21f433 (DEFAULT_TABLE table=default.Table_9b7a6afec0d2423ea15d59b70e646e8d [id=9d1d8cf406384f4291a4f52655394cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.368726 24266 ts_tablet_manager.cc:1428] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.083s user 0.005s sys 0.001s
I20260807 11:08:55.369338 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af30e8f4acfb48db875017c1db21f433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.369452 24019 tablet_service.cc:1467] Processing CreateTablet for tablet af30e8f4acfb48db875017c1db21f433 (DEFAULT_TABLE table=default.Table_9b7a6afec0d2423ea15d59b70e646e8d [id=9d1d8cf406384f4291a4f52655394cf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.369890 24266 tablet_bootstrap.cc:492] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:55.388149 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af30e8f4acfb48db875017c1db21f433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.391075 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af30e8f4acfb48db875017c1db21f433. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:55.391469 23507 consensus_peers.cc:487] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0071aac25afa4100b98c4811cf3e6b2e. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:55.393658 24506 ts_tablet_manager.cc:1918] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:55.394093 24506 log.cc:1196] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/555f31aac90945f8b8a53396a9dbbe4b
I20260807 11:08:55.394917 24506 ts_tablet_manager.cc:1939] T 555f31aac90945f8b8a53396a9dbbe4b P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:55.395102 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f87bb654c84064b7bc26864ceb9755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.403302 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_c3485c1fbb944ca29c99d5da8d146c32" } new_table_name: "default.Table_4d723c16c0a4467983d16fc085d8a92c" modify_external_catalogs: true
I20260807 11:08:55.410169 23045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet c12bb5a459df41e0b0eb87534cb5959a
I20260807 11:08:55.411615 24368 raft_consensus.cc:482] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.412281 24368 raft_consensus.cc:504] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.415211 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet c12bb5a459df41e0b0eb87534cb5959a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:55.417289 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb920ddfaaa423387c98112b52fc2e7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:55.419081 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet c12bb5a459df41e0b0eb87534cb5959a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:52302
W20260807 11:08:55.419118 23745 leader_election.cc:341] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.420038 24261 tablet_bootstrap.cc:700] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Time spent opening tablet: real 0.106s user 0.003s sys 0.001s
I20260807 11:08:55.419812 24368 leader_election.cc:288] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:55.420581 24261 tablet_bootstrap.cc:654] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:55.422206 23048 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed5973e2e1b043dbb896d8461a423cae has no consensus state
I20260807 11:08:55.426317 24777 ts_tablet_manager.cc:1918] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:55.431044 24777 log.cc:1196] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/d5260c798aa645e5becf393f06528f87
I20260807 11:08:55.431929 24777 ts_tablet_manager.cc:1939] T d5260c798aa645e5becf393f06528f87 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:55.439715 23048 master_service.cc:946] ReplaceTablet: received request to replace tablet 11c31c37cb2a4d1d8396a79de7d2493c from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:55.440104 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 24f87bb654c84064b7bc26864ceb9755 (DEFAULT_TABLE table=default.Table_1e2e0850d0394751b215be889b722ade [id=8cb8accd8f7b4559824a1643fd9c100f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.454290 24008 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc42a1f14754b2fadd8eb5337b87057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:48 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.455292 24013 tablet_service.cc:1467] Processing CreateTablet for tablet d3011806841f46f898920b1a11404f85 (DEFAULT_TABLE table=default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.456077 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb920ddfaaa423387c98112b52fc2e7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:55.456831 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3011806841f46f898920b1a11404f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.454290 24007 tablet_service.cc:1514] Processing DeleteTablet for tablet c12bb5a459df41e0b0eb87534cb5959a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.460784 24506 tablet_replica.cc:330] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:55.461447 24506 raft_consensus.cc:2229] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:55.461831 24506 raft_consensus.cc:2258] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:55.462757 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f87bb654c84064b7bc26864ceb9755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.467592 23583 tablet_service.cc:1467] Processing CreateTablet for tablet d3011806841f46f898920b1a11404f85 (DEFAULT_TABLE table=default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.468058 23581 tablet_service.cc:1467] Processing CreateTablet for tablet da4a85755e5a4f53ba2d785020b0a8e2 (DEFAULT_TABLE table=default.Table_30b02767d83b41a48e58f46544825d48 [id=4e04c93b9a4c4ce988f22fbe3a021742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.468562 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3011806841f46f898920b1a11404f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.469339 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 555f31aac90945f8b8a53396a9dbbe4b (table default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]) successfully deleted
W20260807 11:08:55.469964 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 7a7ccf34faf345998028f67921927f0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a7ccf34faf345998028f67921927f0e already in progress: creating tablet
I20260807 11:08:55.470115 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7d0cab3da641f4abca60a8beff381e (DEFAULT_TABLE table=default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:55.470541 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 573b681662bc409aa36ccc65e14e9841 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 573b681662bc409aa36ccc65e14e9841 already in progress: creating tablet
I20260807 11:08:55.471019 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7d0cab3da641f4abca60a8beff381e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.475221 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da4a85755e5a4f53ba2d785020b0a8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.432433 23795 tablet_service.cc:1467] Processing CreateTablet for tablet 24f87bb654c84064b7bc26864ceb9755 (DEFAULT_TABLE table=default.Table_1e2e0850d0394751b215be889b722ade [id=8cb8accd8f7b4559824a1643fd9c100f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.479796 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f87bb654c84064b7bc26864ceb9755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.440409 23797 tablet_service.cc:1467] Processing CreateTablet for tablet d3011806841f46f898920b1a11404f85 (DEFAULT_TABLE table=default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.483685 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 135) took 1304 ms. Trace:
I20260807 11:08:55.483713 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3011806841f46f898920b1a11404f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.455088 23796 tablet_service.cc:1467] Processing CreateTablet for tablet da4a85755e5a4f53ba2d785020b0a8e2 (DEFAULT_TABLE table=default.Table_30b02767d83b41a48e58f46544825d48 [id=4e04c93b9a4c4ce988f22fbe3a021742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.487843 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da4a85755e5a4f53ba2d785020b0a8e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:55.457597 23745 leader_election.cc:341] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.489512 23745 leader_election.cc:302] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.463515 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7d0cab3da641f4abca60a8beff381e (DEFAULT_TABLE table=default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.490779 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7d0cab3da641f4abca60a8beff381e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.495388 24368 raft_consensus.cc:2726] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:55.527051 24262 tablet_bootstrap.cc:492] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:55.527473 24262 ts_tablet_manager.cc:1397] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.321s user 0.022s sys 0.002s
I20260807 11:08:55.552932 24506 ts_tablet_manager.cc:1905] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:55.554530 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_49cb17e7687c4e068540db74dfe3e793" } modify_external_catalogs: true
I20260807 11:08:55.555105 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_49cb17e7687c4e068540db74dfe3e793" } modify_external_catalogs: true
I20260807 11:08:55.556866 24018 tablet_service.cc:1467] Processing CreateTablet for tablet da4a85755e5a4f53ba2d785020b0a8e2 (DEFAULT_TABLE table=default.Table_30b02767d83b41a48e58f46544825d48 [id=4e04c93b9a4c4ce988f22fbe3a021742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.557826 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da4a85755e5a4f53ba2d785020b0a8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.484107 24777 rpcz_store.cc:276] 0807 11:08:54.179360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.179539 (+ 179us) service_pool.cc:227] Handling call
0807 11:08:55.173055 (+993516us) ts_tablet_manager.cc:1145] Deleting tablet d5260c798aa645e5becf393f06528f87
0807 11:08:55.173096 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:55.203658 (+ 30562us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:55.426055 (+222397us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:55.483607 (+ 57552us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":992908}
I20260807 11:08:55.561187 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 136) took 1354 ms. Trace:
I20260807 11:08:55.561398 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet d5260c798aa645e5becf393f06528f87 (table default.Table_6fea2efc5c174bc18527ba33443d3a55 [id=630fa1b8352d4c6ca779091945333560]) successfully deleted
I20260807 11:08:55.469007 24007 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7d0cab3da641f4abca60a8beff381e (DEFAULT_TABLE table=default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.563345 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7d0cab3da641f4abca60a8beff381e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.576750 23048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 11c31c37cb2a4d1d8396a79de7d2493c
I20260807 11:08:55.577747 24261 tablet_bootstrap.cc:492] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:55.578117 23048 catalog_manager.cc:6565] ReplaceTablet: tablet 11c31c37cb2a4d1d8396a79de7d2493c deleted and replaced by tablet 6fde3f237aa54f24b955c4244224a6ea
I20260807 11:08:55.578213 24261 ts_tablet_manager.cc:1397] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.270s user 0.006s sys 0.010s
I20260807 11:08:55.582976 23572 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c31c37cb2a4d1d8396a79de7d2493c with delete_type TABLET_DATA_DELETED (replaced by tablet 6fde3f237aa54f24b955c4244224a6ea) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:55.583382 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_ea2db3b5e44a42f78e63ba9a33356768"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:55.584923 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea2db3b5e44a42f78e63ba9a33356768 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:55.592017 23043 master_service.cc:946] ReplaceTablet: received request to replace tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:55.601882 24261 raft_consensus.cc:348] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:55.607110 24261 raft_consensus.cc:374] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:55.608239 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c31c37cb2a4d1d8396a79de7d2493c with delete_type TABLET_DATA_DELETED (replaced by tablet 6fde3f237aa54f24b955c4244224a6ea) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.608565 24261 raft_consensus.cc:729] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:55.612152 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c31c37cb2a4d1d8396a79de7d2493c with delete_type TABLET_DATA_DELETED (replaced by tablet 6fde3f237aa54f24b955c4244224a6ea) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:55.620451 23035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 81f0b6867c524174a48a92758e566a95
I20260807 11:08:55.622779 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f0b6867c524174a48a92758e566a95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:55.625466 23573 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f0b6867c524174a48a92758e566a95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:55.632335 24261 consensus_queue.cc:260] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:55.530138 24262 raft_consensus.cc:348] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.633723 24262 raft_consensus.cc:374] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:55.634207 24262 raft_consensus.cc:729] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:55.635308 24262 consensus_queue.cc:260] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.646909 24262 ts_tablet_manager.cc:1428] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.119s user 0.002s sys 0.005s
I20260807 11:08:55.649276 24262 tablet_bootstrap.cc:492] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:55.656798 24261 ts_tablet_manager.cc:1428] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.078s user 0.006s sys 0.001s
I20260807 11:08:55.666992 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f0b6867c524174a48a92758e566a95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:55 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:55.669476 24266 tablet_bootstrap.cc:654] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:55.672276 24593 ts_tablet_manager.cc:1918] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:55.672812 24593 log.cc:1196] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/d5260c798aa645e5becf393f06528f87
I20260807 11:08:55.673710 24593 ts_tablet_manager.cc:1939] T d5260c798aa645e5becf393f06528f87 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:55.682040 24261 tablet_bootstrap.cc:492] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:55.704131 24835 raft_consensus.cc:482] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.711017 24261 tablet_bootstrap.cc:654] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:55.711351 24262 tablet_bootstrap.cc:654] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:55.711637 23913 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:55.561637 24777 rpcz_store.cc:276] 0807 11:08:54.206347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.206494 (+ 147us) service_pool.cc:227] Handling call
0807 11:08:55.560270 (+1353776us) ts_tablet_manager.cc:1145] Deleting tablet 275ff54bfeae4fd3ad19e697a2b83e74
0807 11:08:55.560320 (+ 50us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:55.560708 (+ 388us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1351478}
I20260807 11:08:55.715340 24777 tablet_replica.cc:330] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:55.716163 24777 raft_consensus.cc:2229] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:55.716611 24777 raft_consensus.cc:2258] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:55.724419 23573 tablet_service.cc:1467] Processing CreateTablet for tablet 741fdb38a64c4e63a6efc447c6f5ca1f (DEFAULT_TABLE table=default.Table_6f8c96453d0f4d3f8465677953583882 [id=9e5c74477bb5499fa65ebac48712d2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.725371 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741fdb38a64c4e63a6efc447c6f5ca1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.725231 23583 tablet_service.cc:1467] Processing CreateTablet for tablet da7c92ce240b4bbf8aa2457e5ec0ccb0 (DEFAULT_TABLE table=default.Table_2cbdc073cd0242d9ba358f06215755d3 [id=03bf1751e8404c34a38d083358a153a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.725737 23572 tablet_service.cc:1467] Processing CreateTablet for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd (DEFAULT_TABLE table=default.Table_0823309bd309430dbddea4d2c1cd4694 [id=e2f5d3cc43334b07bcb60ab1e2d71f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.726187 23583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7c92ce240b4bbf8aa2457e5ec0ccb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.726902 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:55.727070 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 66767.5us
I20260807 11:08:55.729331 23581 tablet_service.cc:1467] Processing CreateTablet for tablet d6ec7dbecd7a4fb0a0da16e00df84d22 (DEFAULT_TABLE table=default.Table_c3b1895765b44a4eae9efabea2a2e456 [id=d234e8cf6d8546639f2c3420c16b9cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.729303 24011 tablet_service.cc:1467] Processing CreateTablet for tablet 741fdb38a64c4e63a6efc447c6f5ca1f (DEFAULT_TABLE table=default.Table_6f8c96453d0f4d3f8465677953583882 [id=9e5c74477bb5499fa65ebac48712d2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.730206 23581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6ec7dbecd7a4fb0a0da16e00df84d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.730333 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741fdb38a64c4e63a6efc447c6f5ca1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.731443 24019 tablet_service.cc:1467] Processing CreateTablet for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd (DEFAULT_TABLE table=default.Table_0823309bd309430dbddea4d2c1cd4694 [id=e2f5d3cc43334b07bcb60ab1e2d71f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.730661 24017 tablet_service.cc:1467] Processing CreateTablet for tablet d6ec7dbecd7a4fb0a0da16e00df84d22 (DEFAULT_TABLE table=default.Table_c3b1895765b44a4eae9efabea2a2e456 [id=d234e8cf6d8546639f2c3420c16b9cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.732295 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.734712 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6ec7dbecd7a4fb0a0da16e00df84d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.735664 24008 tablet_service.cc:1467] Processing CreateTablet for tablet da7c92ce240b4bbf8aa2457e5ec0ccb0 (DEFAULT_TABLE table=default.Table_2cbdc073cd0242d9ba358f06215755d3 [id=03bf1751e8404c34a38d083358a153a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.736632 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7c92ce240b4bbf8aa2457e5ec0ccb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.739634 24012 tablet_service.cc:1467] Processing CreateTablet for tablet 81f0b6867c524174a48a92758e566a95 (DEFAULT_TABLE table=default.Table_49cb17e7687c4e068540db74dfe3e793 [id=a9028e3c6a1b4669b039a9813cd0ee85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.740590 24012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f0b6867c524174a48a92758e566a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.740389 23571 tablet_service.cc:1467] Processing CreateTablet for tablet 39efd13118454aa983918238928ef2bc (DEFAULT_TABLE table=default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.741374 23571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39efd13118454aa983918238928ef2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.743474 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 39efd13118454aa983918238928ef2bc (DEFAULT_TABLE table=default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.744352 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39efd13118454aa983918238928ef2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.747572 23570 tablet_service.cc:1467] Processing CreateTablet for tablet 81f0b6867c524174a48a92758e566a95 (DEFAULT_TABLE table=default.Table_49cb17e7687c4e068540db74dfe3e793 [id=a9028e3c6a1b4669b039a9813cd0ee85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.748551 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f0b6867c524174a48a92758e566a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.753885 23580 tablet_service.cc:1467] Processing CreateTablet for tablet 4e965a1dc66c414285df6727d2982e12 (DEFAULT_TABLE table=default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.755504 23580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e965a1dc66c414285df6727d2982e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.758173 24729 raft_consensus.cc:482] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.758579 24729 raft_consensus.cc:504] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.761227 24729 leader_election.cc:288] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:55.718487 24835 raft_consensus.cc:504] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:55.763197 24835 leader_election.cc:288] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:55.765087 24777 ts_tablet_manager.cc:1905] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:55.766115 24771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=7 ignored=0} inserts{seen=9 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20260807 11:08:55.773442 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:55.775988 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:55.777489 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:55.780354 23745 leader_election.cc:341] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:55.781601 23745 leader_election.cc:341] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.787580 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 4e965a1dc66c414285df6727d2982e12 (DEFAULT_TABLE table=default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.788630 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e965a1dc66c414285df6727d2982e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.789322 23035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4c5d794da7e44ab3930228c578241301" } modify_external_catalogs: true
I20260807 11:08:55.790316 23035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_4c5d794da7e44ab3930228c578241301" } modify_external_catalogs: true
I20260807 11:08:55.789311 24771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Bootstrap complete.
I20260807 11:08:55.791993 23799 tablet_service.cc:1467] Processing CreateTablet for tablet 4e965a1dc66c414285df6727d2982e12 (DEFAULT_TABLE table=default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.793092 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e965a1dc66c414285df6727d2982e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.796221 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 741fdb38a64c4e63a6efc447c6f5ca1f (DEFAULT_TABLE table=default.Table_6f8c96453d0f4d3f8465677953583882 [id=9e5c74477bb5499fa65ebac48712d2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.797318 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741fdb38a64c4e63a6efc447c6f5ca1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:55.797803 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 275ff54bfeae4fd3ad19e697a2b83e74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 275ff54bfeae4fd3ad19e697a2b83e74 already in progress: creating tablet
I20260807 11:08:55.798431 24506 ts_tablet_manager.cc:1918] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:55.798768 24506 log.cc:1196] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/9fc42a1f14754b2fadd8eb5337b87057
I20260807 11:08:55.799391 24506 ts_tablet_manager.cc:1939] T 9fc42a1f14754b2fadd8eb5337b87057 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:55.802563 23036 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_f5086f7400214c24a865b6fda8ca94ab" } new_table_name: "default.Table_a6db15451abd4a1ca32ce8f2c440b936" modify_external_catalogs: true
I20260807 11:08:55.803010 23040 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_6d0d642c3b424c3388505b3ba6a6bb25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:55.804948 23040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d0d642c3b424c3388505b3ba6a6bb25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:55.806238 23041 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_068a29afd43d4b3389b7c2f992abf956" } new_table_name: "default.Table_d9bd2b2348cb4614a4bd7c207186a696" modify_external_catalogs: true
I20260807 11:08:55.807143 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_087f134702a64647bd34ce9f69e750e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:55.808499 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_087f134702a64647bd34ce9f69e750e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:55.816005 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:55.787058 23745 leader_election.cc:341] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.837371 24734 raft_consensus.cc:482] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:55.840812 24734 raft_consensus.cc:504] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:55.834614 23745 leader_election.cc:302] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.852137 24261 tablet_bootstrap.cc:492] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:55.852505 24266 tablet_bootstrap.cc:492] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:55.852579 24261 ts_tablet_manager.cc:1397] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.171s user 0.008s sys 0.004s
I20260807 11:08:55.852933 24266 ts_tablet_manager.cc:1397] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.483s user 0.006s sys 0.013s
I20260807 11:08:55.856423 24266 raft_consensus.cc:348] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:55.857103 24266 raft_consensus.cc:374] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:55.857366 24266 raft_consensus.cc:729] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:55.868317 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 128) took 2083 ms. Trace:
I20260807 11:08:55.868834 24593 rpcz_store.cc:276] 0807 11:08:53.784678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:53.784804 (+ 126us) service_pool.cc:227] Handling call
0807 11:08:55.193392 (+1408588us) ts_tablet_manager.cc:1145] Deleting tablet d5260c798aa645e5becf393f06528f87
0807 11:08:55.193443 (+ 51us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:55.377151 (+183708us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:55.611135 (+233984us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:55.868235 (+257100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408029}
I20260807 11:08:55.869906 24833 raft_consensus.cc:2726] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:55.870162 23796 tablet_service.cc:1467] Processing CreateTablet for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd (DEFAULT_TABLE table=default.Table_0823309bd309430dbddea4d2c1cd4694 [id=e2f5d3cc43334b07bcb60ab1e2d71f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.871732 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.874822 24842 tablet.cc:1722] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260807 11:08:55.890533 23510 leader_election.cc:341] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Not found: Tablet not found: 9fc42a1f14754b2fadd8eb5337b87057
I20260807 11:08:55.893891 23797 tablet_service.cc:1467] Processing CreateTablet for tablet d6ec7dbecd7a4fb0a0da16e00df84d22 (DEFAULT_TABLE table=default.Table_c3b1895765b44a4eae9efabea2a2e456 [id=d234e8cf6d8546639f2c3420c16b9cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.895792 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6ec7dbecd7a4fb0a0da16e00df84d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.893630 24266 consensus_queue.cc:260] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
W20260807 11:08:55.899619 23507 leader_election.cc:341] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 9fc42a1f14754b2fadd8eb5337b87057
I20260807 11:08:55.900008 23507 leader_election.cc:302] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.909106 24734 leader_election.cc:288] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:55.917171 23803 tablet_service.cc:1467] Processing CreateTablet for tablet da7c92ce240b4bbf8aa2457e5ec0ccb0 (DEFAULT_TABLE table=default.Table_2cbdc073cd0242d9ba358f06215755d3 [id=03bf1751e8404c34a38d083358a153a1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260807 11:08:55.934464 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 147739us
I20260807 11:08:55.935173 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7c92ce240b4bbf8aa2457e5ec0ccb0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:08:55.936403 23745 leader_election.cc:341] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:55.936877 23745 leader_election.cc:302] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:55.937553 24833 raft_consensus.cc:2726] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:55.941959 24841 tablet.cc:1722] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260807 11:08:55.948477 24266 ts_tablet_manager.cc:1428] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.095s user 0.004s sys 0.005s
I20260807 11:08:55.949335 24266 tablet_bootstrap.cc:492] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:55.956158 24262 tablet_bootstrap.cc:492] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:55.956681 24262 ts_tablet_manager.cc:1397] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.309s user 0.012s sys 0.011s
I20260807 11:08:55.958629 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 9fc42a1f14754b2fadd8eb5337b87057 (table default.Table_06348463068444bfa120534ced7a9e25 [id=02196e29e7f34f2cb49d83c13053ca2d]) successfully deleted
W20260807 11:08:55.959610 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 138507us
I20260807 11:08:55.961582 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet d5260c798aa645e5becf393f06528f87 (table default.Table_6fea2efc5c174bc18527ba33443d3a55 [id=630fa1b8352d4c6ca779091945333560]) successfully deleted
I20260807 11:08:55.971429 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:55.978294 23795 tablet_service.cc:1467] Processing CreateTablet for tablet 81f0b6867c524174a48a92758e566a95 (DEFAULT_TABLE table=default.Table_49cb17e7687c4e068540db74dfe3e793 [id=a9028e3c6a1b4669b039a9813cd0ee85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.980597 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f0b6867c524174a48a92758e566a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.982968 23809 tablet_service.cc:1467] Processing CreateTablet for tablet 39efd13118454aa983918238928ef2bc (DEFAULT_TABLE table=default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:08:55.983881 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39efd13118454aa983918238928ef2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:08:55.971654 24850 tablet.cc:1722] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260807 11:08:56.021416 24266 tablet_bootstrap.cc:654] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:56.033854 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 134242us
W20260807 11:08:56.034582 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 48546.9us
W20260807 11:08:56.035398 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet c12bb5a459df41e0b0eb87534cb5959a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c12bb5a459df41e0b0eb87534cb5959a already in progress: creating tablet
W20260807 11:08:56.036477 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 11c31c37cb2a4d1d8396a79de7d2493c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c31c37cb2a4d1d8396a79de7d2493c already in progress: creating tablet
W20260807 11:08:56.037356 23030 catalog_manager.cc:4808] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 81f0b6867c524174a48a92758e566a95 because the tablet was not found. No further retry: Not found: Tablet not found: 81f0b6867c524174a48a92758e566a95
I20260807 11:08:56.052816 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 129) took 2267 ms. Trace:
I20260807 11:08:56.053267 24593 rpcz_store.cc:276] 0807 11:08:53.785692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:53.785856 (+ 164us) service_pool.cc:227] Handling call
0807 11:08:56.023251 (+2237395us) ts_tablet_manager.cc:1145] Deleting tablet 1ce42b3bd73242418f510c5b83259238
0807 11:08:56.046934 (+ 23683us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.052744 (+ 5810us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2236465}
I20260807 11:08:56.058735 24262 raft_consensus.cc:348] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.054615 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 130) took 2267 ms. Trace:
I20260807 11:08:56.067092 24593 rpcz_store.cc:276] 0807 11:08:53.787031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:53.787295 (+ 264us) service_pool.cc:227] Handling call
0807 11:08:56.054280 (+2266985us) ts_tablet_manager.cc:1145] Deleting tablet f4f3bad2ba5e4178b29f52cfb53259db
0807 11:08:56.054321 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.054564 (+ 243us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2266496}
I20260807 11:08:56.068485 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 131) took 1901 ms. Trace:
I20260807 11:08:56.069010 24593 rpcz_store.cc:276] 0807 11:08:54.167359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.167542 (+ 183us) service_pool.cc:227] Handling call
0807 11:08:56.068194 (+1900652us) ts_tablet_manager.cc:1145] Deleting tablet e254839412ad42fcb6d2e22110d5ee24
0807 11:08:56.068246 (+ 52us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.068425 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1899609}
I20260807 11:08:56.070151 24593 tablet_replica.cc:330] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:56.070981 24593 raft_consensus.cc:2229] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:56.086117 24262 raft_consensus.cc:374] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.086404 24262 raft_consensus.cc:729] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.086877 24833 raft_consensus.cc:482] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.087368 24262 consensus_queue.cc:260] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.089993 24593 pending_rounds.cc:62] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Trying to abort 1 pending ops.
I20260807 11:08:56.079216 24846 raft_consensus.cc:482] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.087473 24833 raft_consensus.cc:504] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.084266 24844 raft_consensus.cc:2726] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:56.082384 24261 raft_consensus.cc:348] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.100117 24261 raft_consensus.cc:374] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.100535 24261 raft_consensus.cc:729] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.101235 24261 consensus_queue.cc:260] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.095780 24833 leader_election.cc:288] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:56.103914 24262 ts_tablet_manager.cc:1428] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.147s user 0.003s sys 0.007s
I20260807 11:08:56.104491 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:56.105147 23613 raft_consensus.cc:2454] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:08:56.111864 24261 ts_tablet_manager.cc:1428] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.259s user 0.007s sys 0.006s
I20260807 11:08:56.093824 24846 raft_consensus.cc:504] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:56.114382 24846 leader_election.cc:288] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:56.115945 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "069c0bb933ce4d29976205e0286071eb" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:56.119843 23613 raft_consensus.cc:2454] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
I20260807 11:08:56.120736 24266 tablet_bootstrap.cc:492] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:56.121130 24266 ts_tablet_manager.cc:1397] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.172s user 0.007s sys 0.012s
I20260807 11:08:56.121412 23954 leader_election.cc:302] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:08:56.117343 24593 pending_rounds.cc:68] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869425932931072 op_type: NO_OP noop_request { }
I20260807 11:08:56.122219 24593 raft_consensus.cc:2866] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:56.122641 24593 raft_consensus.cc:2258] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.124034 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:56.124595 24057 raft_consensus.cc:2454] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
W20260807 11:08:56.124640 23951 leader_election.cc:341] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 069c0bb933ce4d29976205e0286071eb
I20260807 11:08:56.125598 24846 raft_consensus.cc:2781] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:56.126219 24846 raft_consensus.cc:482] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:56.126909 24846 raft_consensus.cc:3037] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:56.131237 24266 raft_consensus.cc:348] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:56.136758 24266 raft_consensus.cc:374] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.138518 24266 raft_consensus.cc:729] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.106788 24777 ts_tablet_manager.cc:1918] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.142298 24777 log.cc:1196] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/8a2df15b35bd435baaf95a708ec85a37
I20260807 11:08:56.111651 23745 leader_election.cc:302] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:56.143237 24833 raft_consensus.cc:2781] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 11:08:56.143051 24777 ts_tablet_manager.cc:1939] T 8a2df15b35bd435baaf95a708ec85a37 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.143580 24833 raft_consensus.cc:482] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:56.143900 24833 raft_consensus.cc:3037] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Advancing to term 2
I20260807 11:08:56.142454 24266 consensus_queue.cc:260] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:56.150548 24833 raft_consensus.cc:504] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.153738 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:56.154289 24057 raft_consensus.cc:3037] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Advancing to term 2
I20260807 11:08:56.152568 24833 leader_election.cc:288] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:56.166781 24057 raft_consensus.cc:2454] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 2.
I20260807 11:08:56.171270 23745 leader_election.cc:302] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:08:56.172046 24833 raft_consensus.cc:2781] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 11:08:56.144420 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 107078us
I20260807 11:08:56.172887 24833 raft_consensus.cc:686] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 2 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:08:56.155457 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3733d4813197446e9ecc8be58f87eda7" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:56.173676 24833 consensus_queue.cc:237] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.174444 23613 raft_consensus.cc:3037] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Advancing to term 2
I20260807 11:08:56.175516 24266 ts_tablet_manager.cc:1428] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.054s user 0.005s sys 0.005s
I20260807 11:08:56.176461 24266 tablet_bootstrap.cc:492] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:56.179593 24846 raft_consensus.cc:504] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:56.184948 23613 raft_consensus.cc:2454] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 2.
I20260807 11:08:56.170710 24844 raft_consensus.cc:482] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.185858 24844 raft_consensus.cc:504] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.187935 24262 tablet_bootstrap.cc:492] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.188674 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eaf45dad4a944dab77330db6fc53222" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:56.190012 23510 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.191776 24844 leader_election.cc:288] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:56.193965 23027 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 107945us
I20260807 11:08:56.195573 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eaf45dad4a944dab77330db6fc53222" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:56.196165 23841 raft_consensus.cc:2454] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
W20260807 11:08:56.197424 23951 leader_election.cc:341] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 069c0bb933ce4d29976205e0286071eb
I20260807 11:08:56.197451 23507 leader_election.cc:302] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:56.169168 24771 raft_consensus.cc:348] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 1 FOLLOWER]: Replica starting. Triggering 4 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:56.211920 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "069c0bb933ce4d29976205e0286071eb" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:56.212641 23616 raft_consensus.cc:3037] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:56.204213 24846 leader_election.cc:288] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:56.223716 24266 tablet_bootstrap.cc:654] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.227456 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 143) took 1810 ms. Trace:
I20260807 11:08:56.227949 24777 rpcz_store.cc:276] 0807 11:08:54.416585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.416711 (+ 126us) service_pool.cc:227] Handling call
0807 11:08:55.715171 (+1298460us) ts_tablet_manager.cc:1145] Deleting tablet 8a2df15b35bd435baaf95a708ec85a37
0807 11:08:55.715215 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:55.950988 (+235773us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.106539 (+155551us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.227381 (+120842us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":314,"tablet-delete.queue_time_us":1297838}
I20260807 11:08:56.232627 24777 tablet_replica.cc:330] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
W20260807 11:08:56.239117 23027 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.AlterSchema -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 43982.6us
I20260807 11:08:56.241281 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 8a2df15b35bd435baaf95a708ec85a37 (table default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]) successfully deleted
I20260807 11:08:56.244082 24844 raft_consensus.cc:2781] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:56.245007 24844 raft_consensus.cc:482] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:56.245406 24844 raft_consensus.cc:3037] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:56.250247 24777 raft_consensus.cc:2229] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.250756 24777 raft_consensus.cc:2258] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.253665 24777 ts_tablet_manager.cc:1905] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.260531 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_3ad860f1514e47d9951f2ca82b21044f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:08:56.262109 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ad860f1514e47d9951f2ca82b21044f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:56.266993 23043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2
W20260807 11:08:56.276023 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 77574.6us
I20260807 11:08:56.276763 23043 catalog_manager.cc:6565] ReplaceTablet: tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 deleted and replaced by tablet 4c7574a78a6546b6bf3d51635773b693
I20260807 11:08:56.277923 23796 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4c7574a78a6546b6bf3d51635773b693) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:56.277336 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_0823309bd309430dbddea4d2c1cd4694" } modify_external_catalogs: true
I20260807 11:08:56.278725 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_0823309bd309430dbddea4d2c1cd4694" } modify_external_catalogs: true
I20260807 11:08:56.281533 24262 tablet_bootstrap.cc:654] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.285699 24777 ts_tablet_manager.cc:1918] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.286077 24777 log.cc:1196] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/84c78502f0a5485c9ffe4434c14567e0
I20260807 11:08:56.286720 24777 ts_tablet_manager.cc:1939] T 84c78502f0a5485c9ffe4434c14567e0 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.289510 23043 master_service.cc:946] ReplaceTablet: received request to replace tablet b102e85fa1714a29afbc8302be47921e from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:56.290903 23570 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4c7574a78a6546b6bf3d51635773b693) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:56.291477 24012 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4c7574a78a6546b6bf3d51635773b693) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:56.292128 24506 tablet_replica.cc:330] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:56.291088 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eaf45dad4a944dab77330db6fc53222 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4a0700315457384e3ca995de8a4f2) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:56.292814 24506 raft_consensus.cc:2229] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.293264 24506 raft_consensus.cc:2258] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.293254 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 140) took 1913 ms. Trace:
I20260807 11:08:56.293865 24262 tablet_bootstrap.cc:492] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.294242 24262 ts_tablet_manager.cc:1397] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.106s user 0.008s sys 0.006s
I20260807 11:08:56.296355 24262 raft_consensus.cc:348] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.297106 24262 raft_consensus.cc:374] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.297338 24262 raft_consensus.cc:729] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.297894 24262 consensus_queue.cc:260] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.297212 24506 ts_tablet_manager.cc:1905] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.293556 24777 rpcz_store.cc:276] 0807 11:08:54.379686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.380767 (+ 1081us) service_pool.cc:227] Handling call
0807 11:08:56.232319 (+1851552us) ts_tablet_manager.cc:1145] Deleting tablet 84c78502f0a5485c9ffe4434c14567e0
0807 11:08:56.232412 (+ 93us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.266647 (+ 34235us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.285476 (+ 18829us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.293188 (+ 7712us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1813282}
I20260807 11:08:56.304158 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 84c78502f0a5485c9ffe4434c14567e0 (table default.Table_63fec34778c14f0f91bd30125c2c071a [id=cc7e00d52d65403ea0b8dcbf0a438066]) successfully deleted
I20260807 11:08:56.305176 24777 tablet_replica.cc:330] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.305999 24777 raft_consensus.cc:2229] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.306509 24777 raft_consensus.cc:2258] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.299885 24262 ts_tablet_manager.cc:1428] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 11:08:56.308197 24262 tablet_bootstrap.cc:492] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.308602 24777 ts_tablet_manager.cc:1905] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.310149 23616 raft_consensus.cc:2454] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:08:56.174044 24261 tablet_bootstrap.cc:492] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:56.321363 24262 tablet_bootstrap.cc:654] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.329515 23954 leader_election.cc:302] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:56.330330 24846 raft_consensus.cc:2781] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:56.330814 24846 raft_consensus.cc:686] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
I20260807 11:08:56.331496 24593 ts_tablet_manager.cc:1905] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.332195 24846 consensus_queue.cc:237] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:56.333601 24262 tablet_bootstrap.cc:492] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.334722 24841 tablet.cc:1722] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260807 11:08:56.342779 24850 tablet.cc:1722] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260807 11:08:56.343356 24262 ts_tablet_manager.cc:1397] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.010s
I20260807 11:08:56.347893 24262 raft_consensus.cc:348] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.348526 24262 raft_consensus.cc:374] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.348786 24262 raft_consensus.cc:729] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
W20260807 11:08:56.349611 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 59840.3us
I20260807 11:08:56.349346 24262 consensus_queue.cc:260] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:56.350306 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 1ce42b3bd73242418f510c5b83259238 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ce42b3bd73242418f510c5b83259238 already in progress: creating tablet
W20260807 11:08:56.353008 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet f4f3bad2ba5e4178b29f52cfb53259db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f3bad2ba5e4178b29f52cfb53259db already in progress: creating tablet
W20260807 11:08:56.353960 23030 catalog_manager.cc:4808] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet e254839412ad42fcb6d2e22110d5ee24 because the tablet was not found. No further retry: Not found: Tablet not found: e254839412ad42fcb6d2e22110d5ee24
I20260807 11:08:56.354683 23046 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 2 got 1
I20260807 11:08:56.356941 24262 ts_tablet_manager.cc:1428] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260807 11:08:56.358657 24262 tablet_bootstrap.cc:492] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.363827 24262 tablet_bootstrap.cc:654] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.364133 24261 tablet_bootstrap.cc:654] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.364812 24506 ts_tablet_manager.cc:1918] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:56.365209 24506 log.cc:1196] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/b5a2ef08f9524cb9bc89a7e4b9dcb5d2
I20260807 11:08:56.365876 24506 ts_tablet_manager.cc:1939] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:56.368388 24266 tablet_bootstrap.cc:492] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:56.368759 24266 ts_tablet_manager.cc:1397] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.192s user 0.015s sys 0.006s
I20260807 11:08:56.376364 24844 raft_consensus.cc:504] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.395632 24262 tablet_bootstrap.cc:492] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.396057 24262 ts_tablet_manager.cc:1397] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.006s
I20260807 11:08:56.398025 24777 ts_tablet_manager.cc:1918] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.398423 24777 log.cc:1196] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/10f6d2989e09466aaa374575a11f40e3
I20260807 11:08:56.398172 24262 raft_consensus.cc:348] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.398835 24262 raft_consensus.cc:374] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.399109 24262 raft_consensus.cc:729] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.400015 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eaf45dad4a944dab77330db6fc53222" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:56.401109 24262 consensus_queue.cc:260] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:56.401598 23510 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.389998 24842 tablet.cc:1722] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260807 11:08:56.406774 23029 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet dde5287f17a944708d7678c57bf37bf9 (table default.Table_a46f408876e040f7abc059e728d04a9c [id=d8165adfe8ce4053b5b35900f89cd0de], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet dde5287f17a944708d7678c57bf37bf9 consensus state has no leader
I20260807 11:08:56.407212 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eaf45dad4a944dab77330db6fc53222" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:56.408032 23841 raft_consensus.cc:3037] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:56.411648 24262 ts_tablet_manager.cc:1428] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260807 11:08:56.412477 24262 tablet_bootstrap.cc:492] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.398097 24844 leader_election.cc:288] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:56.415848 24777 ts_tablet_manager.cc:1939] T 10f6d2989e09466aaa374575a11f40e3 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.418715 24266 raft_consensus.cc:348] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.419489 24266 raft_consensus.cc:374] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.419771 24266 raft_consensus.cc:729] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.420552 24262 tablet_bootstrap.cc:654] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.420512 24266 consensus_queue.cc:260] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.422827 24266 ts_tablet_manager.cc:1428] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.054s user 0.005s sys 0.001s
I20260807 11:08:56.427013 24844 raft_consensus.cc:482] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.427563 24844 raft_consensus.cc:504] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.428102 24266 tablet_bootstrap.cc:492] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:56.428817 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 147) took 1819 ms. Trace:
I20260807 11:08:56.429190 24777 rpcz_store.cc:276] 0807 11:08:54.609859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.610424 (+ 565us) service_pool.cc:227] Handling call
0807 11:08:56.305013 (+1694589us) ts_tablet_manager.cc:1145] Deleting tablet 10f6d2989e09466aaa374575a11f40e3
0807 11:08:56.305062 (+ 49us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.342221 (+ 37159us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.397791 (+ 55570us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.428749 (+ 30958us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1693909}
I20260807 11:08:56.430461 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 10f6d2989e09466aaa374575a11f40e3 (table default.Table_446937ecf2464c339f98882c9fe91d9f [id=0539f52e4bd14f138463f5f80bb8bff5]) successfully deleted
I20260807 11:08:56.430383 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:56.430712 24777 tablet_replica.cc:330] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.431546 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:08:56.431871 23510 leader_election.cc:341] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.432112 23844 raft_consensus.cc:2454] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:56.432551 24262 tablet_bootstrap.cc:492] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.432925 24262 ts_tablet_manager.cc:1397] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.006s
I20260807 11:08:56.433107 24777 raft_consensus.cc:2229] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.433166 23507 leader_election.cc:302] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:56.433568 24777 raft_consensus.cc:2258] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.433882 24852 raft_consensus.cc:2781] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:56.434185 24852 raft_consensus.cc:482] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:56.434464 24852 raft_consensus.cc:3037] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:56.435233 24777 ts_tablet_manager.cc:1905] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.435173 24771 raft_consensus.cc:729] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43b3e5203ee4ac3a23fa1902356994b, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.435108 24262 raft_consensus.cc:348] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.435925 24262 raft_consensus.cc:374] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.436159 24262 raft_consensus.cc:729] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.436719 24262 consensus_queue.cc:260] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.410573 23046 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 2 got 1
I20260807 11:08:56.441452 24852 raft_consensus.cc:504] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.442660 24262 ts_tablet_manager.cc:1428] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260807 11:08:56.443481 24262 tablet_bootstrap.cc:492] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.444362 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:56.445631 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
W20260807 11:08:56.445852 23510 leader_election.cc:341] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.446216 23844 raft_consensus.cc:3037] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:56.446445 24852 leader_election.cc:288] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:56.456866 24262 tablet_bootstrap.cc:654] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.462880 24833 raft_consensus.cc:482] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.463450 24833 raft_consensus.cc:504] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.466060 24833 leader_election.cc:288] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:56.468479 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce42b3bd73242418f510c5b83259238" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:56.436534 24771 consensus_queue.cc:260] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:56.469139 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce42b3bd73242418f510c5b83259238" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:56.470335 23745 leader_election.cc:341] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:56.470978 23745 leader_election.cc:341] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.471279 23745 leader_election.cc:302] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:56.472394 24262 tablet_bootstrap.cc:492] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.472793 24262 ts_tablet_manager.cc:1397] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.010s
I20260807 11:08:56.472960 24833 raft_consensus.cc:2726] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:56.475960 24262 raft_consensus.cc:348] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.476552 24262 raft_consensus.cc:374] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.476934 24262 raft_consensus.cc:729] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.477155 24874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:08:56.477631 24262 consensus_queue.cc:260] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.479722 24262 ts_tablet_manager.cc:1428] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260807 11:08:56.478071 24874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:56.482010 24262 tablet_bootstrap.cc:492] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.488965 24777 ts_tablet_manager.cc:1918] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.489481 24777 log.cc:1196] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/2ac76be04eca4d7d9d7f0cf6956fd56a
I20260807 11:08:56.490198 24777 ts_tablet_manager.cc:1939] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.492055 24874 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:56.497151 24262 tablet_bootstrap.cc:654] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.497608 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 3 candidate_status { last_received { term: 2 index: 250 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:56.432538 24844 leader_election.cc:288] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:56.510277 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 153764us
I20260807 11:08:56.512387 24012 tablet_service.cc:1514] Processing DeleteTablet for tablet 069c0bb933ce4d29976205e0286071eb with delete_type TABLET_DATA_DELETED (replaced by tablet fb1504be4320471687d86a55a9891081) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:56.512822 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet b102e85fa1714a29afbc8302be47921e with delete_type TABLET_DATA_DELETED (replaced by tablet 6a427e865f1c4d938483a8222a95307e) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:56.513589 24506 tablet_replica.cc:330] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:56.514323 24506 raft_consensus.cc:2229] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:56.515105 24506 pending_rounds.cc:62] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Trying to abort 1 pending ops.
I20260807 11:08:56.515308 24506 pending_rounds.cc:68] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869435226181632 op_type: NO_OP noop_request { }
I20260807 11:08:56.515717 24506 raft_consensus.cc:2866] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:56.516011 24506 raft_consensus.cc:2258] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.517570 23841 raft_consensus.cc:2454] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:56.518014 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 149) took 1907 ms. Trace:
I20260807 11:08:56.518241 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 (table default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]) successfully deleted
I20260807 11:08:56.518371 24777 rpcz_store.cc:276] 0807 11:08:54.611066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.611179 (+ 113us) service_pool.cc:227] Handling call
0807 11:08:56.430555 (+1819376us) ts_tablet_manager.cc:1145] Deleting tablet 2ac76be04eca4d7d9d7f0cf6956fd56a
0807 11:08:56.430594 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.473780 (+ 43186us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.488676 (+ 14896us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.517951 (+ 29275us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1818821}
I20260807 11:08:56.519003 23507 leader_election.cc:302] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:56.519552 24777 tablet_replica.cc:330] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.520267 24777 raft_consensus.cc:2229] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.520699 24777 raft_consensus.cc:2258] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.522011 24844 raft_consensus.cc:2781] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:56.522308 24777 ts_tablet_manager.cc:1905] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.522634 24844 raft_consensus.cc:686] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:56.523475 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 2ac76be04eca4d7d9d7f0cf6956fd56a (table default.Table_e3b15a161c4540f3b477c59b4dafd867 [id=426dfe43370d4e80b67e1365ba7bce51]) successfully deleted
I20260807 11:08:56.527457 23844 raft_consensus.cc:2454] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:56.528813 23507 leader_election.cc:302] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:56.529927 24852 raft_consensus.cc:2781] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:56.533663 24852 raft_consensus.cc:686] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:56.534834 24852 consensus_queue.cc:237] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.555598 23691 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:56.556216 24262 tablet_bootstrap.cc:492] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.556644 24262 ts_tablet_manager.cc:1397] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.075s user 0.006s sys 0.007s
I20260807 11:08:56.558007 24506 ts_tablet_manager.cc:1905] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.559134 24262 raft_consensus.cc:348] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.559785 24262 raft_consensus.cc:374] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.560022 24262 raft_consensus.cc:729] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.565598 23035 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 4874caf6b62f4b16b52d4fbe82a400ac
I20260807 11:08:56.525400 24844 consensus_queue.cc:237] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.574923 24262 consensus_queue.cc:260] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.587674 24262 ts_tablet_manager.cc:1428] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.031s user 0.008s sys 0.000s
I20260807 11:08:56.588627 24262 tablet_bootstrap.cc:492] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.589740 24833 raft_consensus.cc:482] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.590327 24833 raft_consensus.cc:504] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.592617 24777 ts_tablet_manager.cc:1918] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.593252 24777 log.cc:1196] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/5eaf45dad4a944dab77330db6fc53222
I20260807 11:08:56.593941 24777 ts_tablet_manager.cc:1939] T 5eaf45dad4a944dab77330db6fc53222 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.595345 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:56.595758 24262 tablet_bootstrap.cc:654] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.595824 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 148) took 1985 ms. Trace:
I20260807 11:08:56.596107 24777 rpcz_store.cc:276] 0807 11:08:54.610272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.611205 (+ 933us) service_pool.cc:227] Handling call
0807 11:08:56.519398 (+1908193us) ts_tablet_manager.cc:1145] Deleting tablet 5eaf45dad4a944dab77330db6fc53222
0807 11:08:56.519440 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.537174 (+ 17734us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.592378 (+ 55204us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.595758 (+ 3380us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1907188}
W20260807 11:08:56.596946 23745 leader_election.cc:341] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.598016 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 5eaf45dad4a944dab77330db6fc53222 (table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63]) successfully deleted
I20260807 11:08:56.597990 24833 leader_election.cc:288] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:56.597451 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 154) took 1797 ms. Trace:
I20260807 11:08:56.598791 24777 rpcz_store.cc:276] 0807 11:08:54.799730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.810299 (+ 10569us) service_pool.cc:227] Handling call
0807 11:08:56.597131 (+1786832us) ts_tablet_manager.cc:1145] Deleting tablet 26e0c103c9724de18cf95897f33a101a
0807 11:08:56.597170 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.597405 (+ 235us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1786049}
I20260807 11:08:56.598964 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:56.600162 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 26e0c103c9724de18cf95897f33a101a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26e0c103c9724de18cf95897f33a101a already in progress: creating tablet
W20260807 11:08:56.600895 23745 leader_election.cc:341] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.601263 23745 leader_election.cc:302] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:56.601552 24777 tablet_replica.cc:330] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.602312 24833 raft_consensus.cc:2726] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:56.603495 24777 raft_consensus.cc:2229] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.603987 24777 raft_consensus.cc:2258] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.608049 24777 ts_tablet_manager.cc:1905] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.616976 24261 tablet_bootstrap.cc:492] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:56.617877 24261 ts_tablet_manager.cc:1397] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.444s user 0.008s sys 0.004s
I20260807 11:08:56.620136 24262 tablet_bootstrap.cc:492] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.620544 24262 ts_tablet_manager.cc:1397] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.005s
I20260807 11:08:56.624971 24777 ts_tablet_manager.cc:1918] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.625334 24777 log.cc:1196] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/6ce7963b93094c27b9e25308e68be630
I20260807 11:08:56.626060 24777 ts_tablet_manager.cc:1939] T 6ce7963b93094c27b9e25308e68be630 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.628168 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 156) took 1673 ms. Trace:
I20260807 11:08:56.628504 24266 tablet_bootstrap.cc:654] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.628479 24777 rpcz_store.cc:276] 0807 11:08:54.954385 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.960522 (+ 6137us) service_pool.cc:227] Handling call
0807 11:08:56.601415 (+1640893us) ts_tablet_manager.cc:1145] Deleting tablet 6ce7963b93094c27b9e25308e68be630
0807 11:08:56.601454 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.617327 (+ 15873us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.624754 (+ 7427us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.628108 (+ 3354us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1639890}
I20260807 11:08:56.629691 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 6ce7963b93094c27b9e25308e68be630 (table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9]) successfully deleted
I20260807 11:08:56.629808 24262 raft_consensus.cc:348] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.630501 24262 raft_consensus.cc:374] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.630900 24777 tablet_replica.cc:330] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.631743 24777 raft_consensus.cc:2229] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.632189 24777 raft_consensus.cc:2258] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.634735 24777 ts_tablet_manager.cc:1905] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.630752 24262 raft_consensus.cc:729] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.639428 24262 consensus_queue.cc:260] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.645521 24262 ts_tablet_manager.cc:1428] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.025s user 0.009s sys 0.000s
I20260807 11:08:56.646430 24262 tablet_bootstrap.cc:492] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.653177 23913 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:56.654032 24771 sys_catalog.cc:564] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:08:56.654752 24675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 3 candidate_status { last_received { term: 2 index: 250 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:56.655912 24777 ts_tablet_manager.cc:1918] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.656260 24777 log.cc:1196] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/d78ed82613064935919934df7124d707
I20260807 11:08:56.656396 24675 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18231bef3b524f8ea78d141ae82df928 in term 1.
I20260807 11:08:56.656965 24777 ts_tablet_manager.cc:1939] T d78ed82613064935919934df7124d707 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.658278 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928, b43b3e5203ee4ac3a23fa1902356994b; no voters: 7e598bda106e4ec181b53fc7f305c822
I20260807 11:08:56.664439 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 155) took 1710 ms. Trace:
I20260807 11:08:56.664733 24777 rpcz_store.cc:276] 0807 11:08:54.953998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.961647 (+ 7649us) service_pool.cc:227] Handling call
0807 11:08:56.630683 (+1669036us) ts_tablet_manager.cc:1145] Deleting tablet d78ed82613064935919934df7124d707
0807 11:08:56.630767 (+ 84us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.649226 (+ 18459us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.655723 (+ 6497us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.664386 (+ 8663us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668168}
I20260807 11:08:56.665756 24262 tablet_bootstrap.cc:654] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.666115 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet d78ed82613064935919934df7124d707 (table default.Table_bfdb65009c1f4abebd979f0ebc8d41d5 [id=d5c79d7bd03641dda09bcd556f2f64bf]) successfully deleted
I20260807 11:08:56.675076 24874 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 11:08:56.678272 24874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:08:56.678731 24874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 2 FOLLOWER]: Advancing to term 3
I20260807 11:08:56.683344 24777 tablet_replica.cc:330] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.684077 24777 raft_consensus.cc:2229] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.684499 24777 raft_consensus.cc:2258] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.686138 24777 ts_tablet_manager.cc:1905] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.696609 24266 tablet_bootstrap.cc:492] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:56.697009 24266 ts_tablet_manager.cc:1397] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.269s user 0.003s sys 0.010s
I20260807 11:08:56.639487 24261 raft_consensus.cc:348] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.703717 24777 ts_tablet_manager.cc:1918] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.704169 24777 log.cc:1196] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/64cb221021564d66bfecf5cd91bcec5c
I20260807 11:08:56.704794 24777 ts_tablet_manager.cc:1939] T 64cb221021564d66bfecf5cd91bcec5c P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.707124 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 157) took 1631 ms. Trace:
I20260807 11:08:56.707422 24777 rpcz_store.cc:276] 0807 11:08:55.076261 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.076540 (+ 279us) service_pool.cc:227] Handling call
0807 11:08:56.677572 (+1601032us) ts_tablet_manager.cc:1145] Deleting tablet 64cb221021564d66bfecf5cd91bcec5c
0807 11:08:56.683212 (+ 5640us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.693205 (+ 9993us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.703520 (+ 10315us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.707066 (+ 3546us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1600072}
I20260807 11:08:56.708588 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 64cb221021564d66bfecf5cd91bcec5c (table default.Table_86c6101a5d544b8a9d5dc3f9e22392d6 [id=f875636f9d7f422e8d85b33b269703ac]) successfully deleted
I20260807 11:08:56.709697 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 158) took 1621 ms. Trace:
I20260807 11:08:56.710037 24777 rpcz_store.cc:276] 0807 11:08:55.088178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.091072 (+ 2894us) service_pool.cc:227] Handling call
0807 11:08:56.709383 (+1618311us) ts_tablet_manager.cc:1145] Deleting tablet 7a7ccf34faf345998028f67921927f0e
0807 11:08:56.709423 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.709650 (+ 227us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1606977}
W20260807 11:08:56.711894 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 7a7ccf34faf345998028f67921927f0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a7ccf34faf345998028f67921927f0e already in progress: creating tablet
I20260807 11:08:56.717113 24777 tablet_replica.cc:330] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.717854 24777 raft_consensus.cc:2229] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.718145 24506 ts_tablet_manager.cc:1918] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:56.718341 24777 raft_consensus.cc:2258] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.718568 24506 log.cc:1196] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/069c0bb933ce4d29976205e0286071eb
I20260807 11:08:56.690733 24593 ts_tablet_manager.cc:1918] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:56.720227 24777 ts_tablet_manager.cc:1905] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.697652 24261 raft_consensus.cc:374] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.723920 24261 raft_consensus.cc:729] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.724754 24261 consensus_queue.cc:260] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.727485 24261 ts_tablet_manager.cc:1428] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.109s user 0.004s sys 0.003s
I20260807 11:08:56.731542 24261 tablet_bootstrap.cc:492] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:56.728926 24593 log.cc:1196] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/655d379cab56486d872738de6acdffef
I20260807 11:08:56.735663 24593 ts_tablet_manager.cc:1939] T 655d379cab56486d872738de6acdffef P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:56.736619 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 132) took 2545 ms. Trace:
I20260807 11:08:56.737871 24506 ts_tablet_manager.cc:1939] T 069c0bb933ce4d29976205e0286071eb P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:56.740466 24593 rpcz_store.cc:276] 0807 11:08:54.190826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.195035 (+ 4209us) service_pool.cc:227] Handling call
0807 11:08:56.069974 (+1874939us) ts_tablet_manager.cc:1145] Deleting tablet 655d379cab56486d872738de6acdffef
0807 11:08:56.070016 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.531564 (+461548us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.690438 (+158874us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.736563 (+ 46125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1874248}
I20260807 11:08:56.741751 24777 ts_tablet_manager.cc:1918] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:56.742077 24777 log.cc:1196] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/5fb920ddfaaa423387c98112b52fc2e7
I20260807 11:08:56.742759 24777 ts_tablet_manager.cc:1939] T 5fb920ddfaaa423387c98112b52fc2e7 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.744613 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 162) took 1420 ms. Trace:
I20260807 11:08:56.744899 24777 rpcz_store.cc:276] 0807 11:08:55.324392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.324600 (+ 208us) service_pool.cc:227] Handling call
0807 11:08:56.716963 (+1392363us) ts_tablet_manager.cc:1145] Deleting tablet 5fb920ddfaaa423387c98112b52fc2e7
0807 11:08:56.717003 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.728747 (+ 11744us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.741532 (+ 12785us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:56.744556 (+ 3024us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1390181}
I20260807 11:08:56.746184 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 5fb920ddfaaa423387c98112b52fc2e7 (table default.Table_6de3af683e604dc19feabffc5a34afb5 [id=b0c6bede76844f87acd18ee9fd31efe3]) successfully deleted
W20260807 11:08:56.747229 24871 log.cc:924] Time spent T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: Append to log took a long time: real 0.095s user 0.000s sys 0.002s
I20260807 11:08:56.747449 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 163) took 1419 ms. Trace:
I20260807 11:08:56.748190 24777 rpcz_store.cc:276] 0807 11:08:55.327800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.327995 (+ 195us) service_pool.cc:227] Handling call
0807 11:08:56.747107 (+1419112us) ts_tablet_manager.cc:1145] Deleting tablet 573b681662bc409aa36ccc65e14e9841
0807 11:08:56.747148 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.747399 (+ 251us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1418461}
W20260807 11:08:56.749423 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 573b681662bc409aa36ccc65e14e9841 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 573b681662bc409aa36ccc65e14e9841 already in progress: creating tablet
I20260807 11:08:56.750012 24266 raft_consensus.cc:348] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:56.750454 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 165) took 1337 ms. Trace:
I20260807 11:08:56.750706 24266 raft_consensus.cc:374] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.751097 24266 raft_consensus.cc:729] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.750828 24777 rpcz_store.cc:276] 0807 11:08:55.412700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.414992 (+ 2292us) service_pool.cc:227] Handling call
0807 11:08:56.750143 (+1335151us) ts_tablet_manager.cc:1145] Deleting tablet c12bb5a459df41e0b0eb87534cb5959a
0807 11:08:56.750180 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.750410 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334462}
W20260807 11:08:56.752442 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet c12bb5a459df41e0b0eb87534cb5959a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c12bb5a459df41e0b0eb87534cb5959a already in progress: creating tablet
I20260807 11:08:56.752063 24266 consensus_queue.cc:260] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:56.753530 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 172) took 1173 ms. Trace:
I20260807 11:08:56.753857 24777 rpcz_store.cc:276] 0807 11:08:55.580616 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.611930 (+ 31314us) service_pool.cc:227] Handling call
0807 11:08:56.753181 (+1141251us) ts_tablet_manager.cc:1145] Deleting tablet 11c31c37cb2a4d1d8396a79de7d2493c
0807 11:08:56.753217 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.753482 (+ 265us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139630}
W20260807 11:08:56.755074 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 11c31c37cb2a4d1d8396a79de7d2493c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c31c37cb2a4d1d8396a79de7d2493c already in progress: creating tablet
I20260807 11:08:56.756036 24777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56920 (request call id 173) took 1133 ms. Trace:
I20260807 11:08:56.756393 24777 rpcz_store.cc:276] 0807 11:08:55.622451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.622601 (+ 150us) service_pool.cc:227] Handling call
0807 11:08:56.755751 (+1133150us) ts_tablet_manager.cc:1145] Deleting tablet 81f0b6867c524174a48a92758e566a95
0807 11:08:56.755788 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.755994 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131684}
W20260807 11:08:56.757663 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet 81f0b6867c524174a48a92758e566a95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f0b6867c524174a48a92758e566a95 already in progress: creating tablet
I20260807 11:08:56.758514 24262 tablet_bootstrap.cc:492] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.758561 24777 tablet_replica.cc:330] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:08:56.759454 24777 raft_consensus.cc:2229] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:56.760322 24777 raft_consensus.cc:2258] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.763372 24262 ts_tablet_manager.cc:1397] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.117s user 0.007s sys 0.019s
I20260807 11:08:56.769629 24777 ts_tablet_manager.cc:1905] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.775029 23045 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:53338 (request call id 229) took 1026 ms. Trace:
I20260807 11:08:56.775368 23045 rpcz_store.cc:276] 0807 11:08:55.748781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.806539 (+ 57758us) service_pool.cc:227] Handling call
0807 11:08:56.265470 (+458931us) catalog_manager.cc:2075] Acquired catalog manager lock
0807 11:08:56.317765 (+ 52295us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b0c00031e88. stack: 00007fda4c4f7033 00007fda4c4f6f30 00007fda4c078534 00000000004db2b4 00000000004db249 00007fda4c36df11 00007fda4c47875f 00007fda4c478599 00007fda553304df 00007fda5532e683 00007fda5532becc 00007fda5544e18f 00007fda52f8b034 00007fda52f8afc2 00007fda52f8aef1 00007fda52f8ae6c
0807 11:08:56.318489 (+ 724us) catalog_manager.cc:2121] Created new table and tablet info
0807 11:08:56.774401 (+455912us) catalog_manager.cc:2181] Wrote table and tablets to system table
0807 11:08:56.774692 (+ 291us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0807 11:08:56.774969 (+ 277us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:56.319876 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:56.320230 (+ 354us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:56.320254 (+ 24us) write_op.cc:435] Acquired schema lock
0807 11:08:56.320265 (+ 11us) tablet.cc:660] Decoding operations
0807 11:08:56.320521 (+ 256us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:56.320555 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:56.320575 (+ 20us) tablet.cc:683] Acquiring locks for 2 operations
0807 11:08:56.320754 (+ 179us) tablet.cc:699] Row locks acquired
0807 11:08:56.320766 (+ 12us) write_op.cc:260] PREPARE: finished
0807 11:08:56.320886 (+ 120us) write_op.cc:270] Start()
0807 11:08:56.320965 (+ 79us) write_op.cc:276] Timestamp: P: 1786100936316593 usec, L: 0
0807 11:08:56.320979 (+ 14us) op_driver.cc:331] REPLICATION: starting
0807 11:08:56.321456 (+ 477us) log.cc:842] Serialized 433 byte log entry
0807 11:08:56.767836 (+446380us) op_driver.cc:444] REPLICATION: finished
0807 11:08:56.772009 (+ 4173us) write_op.cc:301] APPLY: starting
0807 11:08:56.772058 (+ 49us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:56.772202 (+ 144us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:56.772368 (+ 166us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:56.772987 (+ 619us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:56.773192 (+ 205us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 11:08:56.773268 (+ 76us) write_op.cc:312] APPLY: finished
0807 11:08:56.773477 (+ 209us) log.cc:842] Serialized 29 byte log entry
0807 11:08:56.774078 (+ 601us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:56.774141 (+ 63us) write_op.cc:454] Released schema lock
0807 11:08:56.774172 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":117391104,"child_traces":[["op",{"apply.queue_time_us":3954,"num_ops":2,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":1790,"prepare.run_wall_time_us":1789,"replication_time_us":446733}]]}
I20260807 11:08:56.780766 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet a6ebc139f3744d6c9682e3c3ab1ae8dd
I20260807 11:08:56.784968 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:56 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:08:56.785717 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6142de128f694ccfb31fcbde5ffd7d94" } modify_external_catalogs: true
I20260807 11:08:56.786232 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6142de128f694ccfb31fcbde5ffd7d94" } modify_external_catalogs: true
I20260807 11:08:56.788156 24119 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:56.788398 23041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_9cc5f868b933436a9237ac18b3aaa690"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:08:56.789814 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
W20260807 11:08:56.789991 23041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cc5f868b933436a9237ac18b3aaa690 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:08:56.787171 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:56 UTC) from {username='slave'} at 127.0.0.1:52302
I20260807 11:08:56.799543 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 655d379cab56486d872738de6acdffef (table default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]) successfully deleted
I20260807 11:08:56.800246 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 133) took 2587 ms. Trace:
I20260807 11:08:56.800712 24593 rpcz_store.cc:276] 0807 11:08:54.213170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.213365 (+ 195us) service_pool.cc:227] Handling call
0807 11:08:56.799293 (+2585928us) ts_tablet_manager.cc:1145] Deleting tablet 275ff54bfeae4fd3ad19e697a2b83e74
0807 11:08:56.799367 (+ 74us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.800187 (+ 820us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2585257}
W20260807 11:08:56.802268 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 275ff54bfeae4fd3ad19e697a2b83e74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 275ff54bfeae4fd3ad19e697a2b83e74 already in progress: creating tablet
I20260807 11:08:56.804323 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 137) took 2429 ms. Trace:
I20260807 11:08:56.804701 24593 rpcz_store.cc:276] 0807 11:08:54.374934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.382988 (+ 8054us) service_pool.cc:227] Handling call
0807 11:08:56.803678 (+2420690us) ts_tablet_manager.cc:1145] Deleting tablet 84c78502f0a5485c9ffe4434c14567e0
0807 11:08:56.803765 (+ 87us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:56.804267 (+ 502us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2359958}
I20260807 11:08:56.806037 24593 tablet_replica.cc:330] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
W20260807 11:08:56.806145 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 84c78502f0a5485c9ffe4434c14567e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84c78502f0a5485c9ffe4434c14567e0 already in progress: creating tablet
I20260807 11:08:56.741852 24874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:56.817157 23187 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 3 FOLLOWER]: Rejecting Update request from peer 7e598bda106e4ec181b53fc7f305c822 for earlier term 2. Current term is 3. Ops: []
I20260807 11:08:56.819867 24884 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 }, Status: INVALID_TERM, Last received: 2.257, Next index: 258, Last known committed idx: 250, Time since last communication: 0.001s
I20260807 11:08:56.821162 24266 ts_tablet_manager.cc:1428] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.124s user 0.007s sys 0.001s
I20260807 11:08:56.821617 24891 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 11:08:56.822027 24266 tablet_bootstrap.cc:492] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:56.822162 24891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e598bda106e4ec181b53fc7f305c822, State: Running, Role: LEADER
I20260807 11:08:56.823354 23037 master_service.cc:946] ReplaceTablet: received request to replace tablet 64cb221021564d66bfecf5cd91bcec5c from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:56.823278 24891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 257, Committed index: 257, Last appended: 2.258, Last appended by leader: 258, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:56.825109 24891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 2 FOLLOWER]: Advancing to term 3
I20260807 11:08:56.827621 24675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 3 candidate_status { last_received { term: 2 index: 257 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b"
I20260807 11:08:56.783536 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:08:56 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:08:56.766287 24262 raft_consensus.cc:348] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.828562 24262 raft_consensus.cc:374] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.828510 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 3 candidate_status { last_received { term: 2 index: 257 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822"
I20260807 11:08:56.828537 24874 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 3 election: Requested vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:56.828840 24262 raft_consensus.cc:729] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.829517 24262 consensus_queue.cc:260] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.831558 24262 ts_tablet_manager.cc:1428] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260807 11:08:56.833611 24261 tablet_bootstrap.cc:654] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.833889 24262 tablet_bootstrap.cc:492] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:56.834520 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 069c0bb933ce4d29976205e0286071eb (table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]) successfully deleted
I20260807 11:08:56.834935 24506 tablet_replica.cc:330] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:08:56.835739 24506 raft_consensus.cc:2229] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:56.836247 24506 raft_consensus.cc:2258] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.837913 24506 ts_tablet_manager.cc:1905] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.868846 24262 tablet_bootstrap.cc:654] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.869174 24777 ts_tablet_manager.cc:1918] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:56.869527 24777 log.cc:1196] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/b5a2ef08f9524cb9bc89a7e4b9dcb5d2
I20260807 11:08:56.870235 24777 ts_tablet_manager.cc:1939] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:08:56.871616 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 (table default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]) successfully deleted
W20260807 11:08:56.875491 23027 catalog_manager.cc:4821] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): delete failed for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6ebc139f3744d6c9682e3c3ab1ae8dd already in progress: creating tablet
I20260807 11:08:56.879719 23065 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18231bef3b524f8ea78d141ae82df928 for term 3 because replica has last-logged OpId of term: 2 index: 258, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 257.
I20260807 11:08:56.885028 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:56.892769 24262 tablet_bootstrap.cc:492] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:56.893237 24262 ts_tablet_manager.cc:1397] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.000s
I20260807 11:08:56.847901 24842 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P 8a668588fabb4a9eba107cd6020f1e93: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260807 11:08:56.898986 24135 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.22.115.254:40237)
I20260807 11:08:56.850873 24850 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P c281254655c84a0496c50045c37b22df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260807 11:08:56.906051 24874 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 11:08:56.911068 24262 raft_consensus.cc:348] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.911808 24262 raft_consensus.cc:374] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:56.912070 24262 raft_consensus.cc:729] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:56.925688 23037 master_service.cc:946] ReplaceTablet: received request to replace tablet b62eea967fed4adc84252b8366609878 from {username='slave'} at 127.0.0.1:53338
I20260807 11:08:56.930090 24593 raft_consensus.cc:2229] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:56.931208 24835 raft_consensus.cc:482] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.931804 24835 raft_consensus.cc:504] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.934531 24835 leader_election.cc:288] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:56.935300 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f41042d50184ecf9bbd2c225c86aabf" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:56.912721 24262 consensus_queue.cc:260] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:56.936337 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f41042d50184ecf9bbd2c225c86aabf" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:56.936937 23745 leader_election.cc:341] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.938587 24262 ts_tablet_manager.cc:1428] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.045s user 0.008s sys 0.000s
I20260807 11:08:56.939498 24262 tablet_bootstrap.cc:492] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:56.940668 23745 leader_election.cc:341] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.941016 23745 leader_election.cc:302] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:56.941973 24833 raft_consensus.cc:2726] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:56.949863 24262 tablet_bootstrap.cc:654] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:56.959046 24593 pending_rounds.cc:62] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Trying to abort 1 pending ops.
I20260807 11:08:56.959483 24835 raft_consensus.cc:482] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:56.959472 24593 pending_rounds.cc:68] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869426365444096 op_type: NO_OP noop_request { }
I20260807 11:08:56.960068 24593 raft_consensus.cc:2866] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:56.960510 24593 raft_consensus.cc:2258] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:56.960157 24835 raft_consensus.cc:504] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:56.962355 24593 ts_tablet_manager.cc:1905] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:56.963167 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cd1107ba80a4dbeaba696a7b7095423" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:56.964588 23745 leader_election.cc:341] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.964347 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cd1107ba80a4dbeaba696a7b7095423" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:56.962580 24835 leader_election.cc:288] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:56.965474 24681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 1 FOLLOWER]: Advancing to term 2
W20260807 11:08:56.965799 23745 leader_election.cc:341] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:56.966138 23745 leader_election.cc:302] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:56.966706 24835 raft_consensus.cc:2726] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:08:56.974285 24135 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.115.254:40237)
I20260807 11:08:56.974134 24915 tablet.cc:1722] T cc7d0d889f2541a9a5c3c45f1c39df06 P 99a8d4e2c1b14150b03ad0f28e74a011: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260807 11:08:56.978048 24135 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.22.115.254:40237)
W20260807 11:08:56.986486 23040 catalog_manager.cc:2785] Illegal state: an error occurred while updating the sys-catalog: replica 7e598bda106e4ec181b53fc7f305c822 is not leader of this config: current role FOLLOWER
I20260807 11:08:56.988976 24261 tablet_bootstrap.cc:492] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:56.989401 24261 ts_tablet_manager.cc:1397] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.258s user 0.005s sys 0.007s
W20260807 11:08:56.997073 24135 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.22.115.254:40237)
I20260807 11:08:57.000815 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet b62eea967fed4adc84252b8366609878 (table default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06]). Expected version 2 got 1
I20260807 11:08:57.001689 23048 catalog_manager.cc:5495] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 reported cstate change: term changed from 0 to 2, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 2 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:08:57.004343 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
I20260807 11:08:57.006454 24266 tablet_bootstrap.cc:654] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.007026 24835 raft_consensus.cc:482] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.007473 24835 raft_consensus.cc:504] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.009347 24835 leader_election.cc:288] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:57.010717 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36b812880814298990c9aee6999f113" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.012080 23745 leader_election.cc:341] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:57.015199 23036 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cd1107ba80a4dbeaba696a7b7095423 consensus state has no leader
I20260807 11:08:57.015728 23036 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:53338 (request call id 228) took 1267 ms. Trace:
I20260807 11:08:57.016001 23036 rpcz_store.cc:276] 0807 11:08:55.748438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.802013 (+ 53575us) service_pool.cc:227] Handling call
0807 11:08:55.803410 (+ 1397us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 11:08:55.804271 (+ 861us) catalog_manager.cc:3616] Apply alter schema
0807 11:08:56.253965 (+449694us) catalog_manager.cc:3639] Acquired catalog manager lock
0807 11:08:56.254340 (+ 375us) catalog_manager.cc:3786] Updating metadata on disk
0807 11:08:56.720960 (+466620us) catalog_manager.cc:3817] Committing alterations to in-memory state
0807 11:08:57.015653 (+294693us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:56.255899 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:56.256279 (+ 380us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:56.256303 (+ 24us) write_op.cc:435] Acquired schema lock
0807 11:08:56.256316 (+ 13us) tablet.cc:660] Decoding operations
0807 11:08:56.256591 (+ 275us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:56.256632 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:56.256652 (+ 20us) tablet.cc:683] Acquiring locks for 1 operations
0807 11:08:56.256815 (+ 163us) tablet.cc:699] Row locks acquired
0807 11:08:56.256828 (+ 13us) write_op.cc:260] PREPARE: finished
0807 11:08:56.256992 (+ 164us) write_op.cc:270] Start()
0807 11:08:56.257085 (+ 93us) write_op.cc:276] Timestamp: P: 1786100936252685 usec, L: 0
0807 11:08:56.257100 (+ 15us) op_driver.cc:331] REPLICATION: starting
0807 11:08:56.257610 (+ 510us) log.cc:842] Serialized 405 byte log entry
0807 11:08:56.717354 (+459744us) op_driver.cc:444] REPLICATION: finished
0807 11:08:56.719247 (+ 1893us) write_op.cc:301] APPLY: starting
0807 11:08:56.719345 (+ 98us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:56.719459 (+ 114us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:56.719611 (+ 152us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:56.719796 (+ 185us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:56.720049 (+ 253us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 11:08:56.720122 (+ 73us) write_op.cc:312] APPLY: finished
0807 11:08:56.720340 (+ 218us) log.cc:842] Serialized 23 byte log entry
0807 11:08:56.720593 (+ 253us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:56.720677 (+ 84us) write_op.cc:454] Released schema lock
0807 11:08:56.720706 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0807 11:08:56.720976 (+ 270us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:56.721003 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1569,"apply.run_cpu_time_us":2012,"apply.run_wall_time_us":2012,"num_ops":1,"prepare.queue_time_us":99,"prepare.run_cpu_time_us":1938,"prepare.run_wall_time_us":1938,"replication_time_us":460165}]]}
I20260807 11:08:57.014562 23043 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06] alter complete (version 2)
I20260807 11:08:57.023152 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 069c0bb933ce4d29976205e0286071eb with delete_type TABLET_DATA_DELETED (replaced by tablet fb1504be4320471687d86a55a9891081) from {username='slave'} at 127.0.0.1:40310
E20260807 11:08:57.024151 23048 catalog_manager.cc:5650] Error updating tablets from 99a8d4e2c1b14150b03ad0f28e74a011: Illegal state: replica 7e598bda106e4ec181b53fc7f305c822 is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: true updated_tablets { tablet_id: "3733d4813197446e9ecc8be58f87eda7" state: RUNNING consensus_state { current_term: 2 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26772 live_row_count: 0 } } updated_tablets { tablet_id: "9cd1107ba80a4dbeaba696a7b7095423" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b62eea967fed4adc84252b8366609878" state: RUNNING consensus_state { current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26847 live_row_count: 0 } } updated_tablets { tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } sequence_number: 46
E20260807 11:08:57.028803 23442 catalog_manager.cc:816] Error processing pending assignments: Illegal state: error persisting updated tablet metadata: replica 7e598bda106e4ec181b53fc7f305c822 is not leader of this config: current role FOLLOWER
I20260807 11:08:57.031615 24262 tablet_bootstrap.cc:492] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:57.032034 24262 ts_tablet_manager.cc:1397] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.093s user 0.027s sys 0.013s
I20260807 11:08:57.035326 24262 raft_consensus.cc:348] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.035924 24262 raft_consensus.cc:374] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.036165 24262 raft_consensus.cc:729] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.036721 24262 consensus_queue.cc:260] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.038611 24262 ts_tablet_manager.cc:1428] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 11:08:57.039409 24262 tablet_bootstrap.cc:492] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:57.055306 24262 tablet_bootstrap.cc:654] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.074808 24262 tablet_bootstrap.cc:492] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:57.076129 24262 ts_tablet_manager.cc:1397] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.007s
I20260807 11:08:57.078904 24266 tablet_bootstrap.cc:492] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:57.079313 24266 ts_tablet_manager.cc:1397] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.257s user 0.019s sys 0.002s
I20260807 11:08:57.081157 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36b812880814298990c9aee6999f113" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:57.082471 24266 raft_consensus.cc:348] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:57.083091 24266 raft_consensus.cc:374] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 11:08:57.083180 23745 leader_election.cc:341] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.083329 24266 raft_consensus.cc:729] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.083603 23745 leader_election.cc:302] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.084365 24835 raft_consensus.cc:2726] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.085675 24262 raft_consensus.cc:348] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.086289 24262 raft_consensus.cc:374] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.086534 24262 raft_consensus.cc:729] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.087144 24262 consensus_queue.cc:260] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.089103 24262 ts_tablet_manager.cc:1428] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.013s user 0.002s sys 0.002s
I20260807 11:08:57.089586 24266 consensus_queue.cc:260] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:57.094802 24262 tablet_bootstrap.cc:492] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:57.101709 24266 ts_tablet_manager.cc:1428] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260807 11:08:57.081051 24261 raft_consensus.cc:348] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.107497 24057 raft_consensus.cc:1261] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Refusing update from remote peer 99a8d4e2c1b14150b03ad0f28e74a011: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 11:08:57.107555 24261 raft_consensus.cc:374] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.107792 24261 raft_consensus.cc:729] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.108871 24846 raft_consensus.cc:482] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.108975 24835 consensus_queue.cc:1035] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:57.109301 24846 raft_consensus.cc:504] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:57.111208 24846 leader_election.cc:288] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:08:57.115486 23951 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
W20260807 11:08:57.116396 23954 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
I20260807 11:08:57.116768 23954 leader_election.cc:302] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:57.117798 24262 tablet_bootstrap.cc:654] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.114492 24266 tablet_bootstrap.cc:492] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:57.122519 24846 raft_consensus.cc:2726] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.138655 23613 raft_consensus.cc:1261] T 3733d4813197446e9ecc8be58f87eda7 P 8a668588fabb4a9eba107cd6020f1e93 [term 2 FOLLOWER]: Refusing update from remote peer 99a8d4e2c1b14150b03ad0f28e74a011: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 11:08:57.141608 24835 consensus_queue.cc:1035] T 3733d4813197446e9ecc8be58f87eda7 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:57.126458 24261 consensus_queue.cc:260] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.160373 24261 ts_tablet_manager.cc:1428] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.171s user 0.007s sys 0.000s
I20260807 11:08:57.161247 24261 tablet_bootstrap.cc:492] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:57.178053 24835 raft_consensus.cc:482] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.178676 24835 raft_consensus.cc:504] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.182144 24835 leader_election.cc:288] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:57.183750 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:57.186306 23745 leader_election.cc:341] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.221248 24261 tablet_bootstrap.cc:654] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.241406 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:57.232517 24846 raft_consensus.cc:482] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.243055 24846 raft_consensus.cc:504] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.244840 24846 leader_election.cc:288] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:57.246234 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0071aac25afa4100b98c4811cf3e6b2e" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:57.247462 23954 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: Tablet not RUNNING: STOPPED
W20260807 11:08:57.249622 23951 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:08:57.250155 23951 leader_election.cc:302] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
W20260807 11:08:57.251931 23745 leader_election.cc:341] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.252331 23745 leader_election.cc:302] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.253877 24833 raft_consensus.cc:2726] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.261739 24835 raft_consensus.cc:482] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.262133 24846 raft_consensus.cc:2726] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.262157 24835 raft_consensus.cc:504] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.254638 24266 tablet_bootstrap.cc:654] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.264752 24835 leader_election.cc:288] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:57.282163 24593 ts_tablet_manager.cc:1918] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:57.287457 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.296830 23745 leader_election.cc:341] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.298924 24266 tablet_bootstrap.cc:492] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:57.299327 24266 ts_tablet_manager.cc:1397] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.185s user 0.015s sys 0.000s
I20260807 11:08:57.305823 24266 raft_consensus.cc:348] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.306466 24266 raft_consensus.cc:374] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.306689 24266 raft_consensus.cc:729] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.309078 24833 raft_consensus.cc:482] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.309811 24833 raft_consensus.cc:504] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.315397 24833 leader_election.cc:288] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:57.316321 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.317447 23745 leader_election.cc:341] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.321941 24506 ts_tablet_manager.cc:1918] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:57.322371 24506 log.cc:1196] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/b102e85fa1714a29afbc8302be47921e
I20260807 11:08:57.323132 24506 ts_tablet_manager.cc:1939] T b102e85fa1714a29afbc8302be47921e P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:08:57.324904 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:57.293852 24844 raft_consensus.cc:482] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.325503 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet b102e85fa1714a29afbc8302be47921e (table default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]) successfully deleted
I20260807 11:08:57.325682 24844 raft_consensus.cc:504] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.327744 24844 leader_election.cc:288] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:57.327919 24262 tablet_bootstrap.cc:492] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:57.293936 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:57.305256 24261 tablet_bootstrap.cc:492] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:57.328316 24262 ts_tablet_manager.cc:1397] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.234s user 0.028s sys 0.050s
I20260807 11:08:57.328537 24261 ts_tablet_manager.cc:1397] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.167s user 0.006s sys 0.010s
I20260807 11:08:57.329923 24593 log.cc:1196] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:08:57.330114 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ce7963b93094c27b9e25308e68be630" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.330803 23507 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
I20260807 11:08:57.331380 24593 ts_tablet_manager.cc:1939] T 0071aac25afa4100b98c4811cf3e6b2e P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:57.331300 24261 raft_consensus.cc:348] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.331940 24261 raft_consensus.cc:374] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.332177 24261 raft_consensus.cc:729] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.332707 24261 consensus_queue.cc:260] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.332943 24262 raft_consensus.cc:348] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.333588 24262 raft_consensus.cc:374] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.333834 24262 raft_consensus.cc:729] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.330981 24266 consensus_queue.cc:260] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.314158 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:57.335556 24057 raft_consensus.cc:2454] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
W20260807 11:08:57.335723 23745 leader_election.cc:341] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.336071 23745 leader_election.cc:302] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.336717 24833 raft_consensus.cc:2726] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:08:57.337728 23745 leader_election.cc:341] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.338076 23745 leader_election.cc:302] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.338673 24833 raft_consensus.cc:2726] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.340087 24266 ts_tablet_manager.cc:1428] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.041s user 0.006s sys 0.000s
I20260807 11:08:57.343907 23510 leader_election.cc:302] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:57.344937 24852 raft_consensus.cc:2781] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:57.345309 24852 raft_consensus.cc:482] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:57.345744 24852 raft_consensus.cc:3037] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:57.347569 24266 tablet_bootstrap.cc:492] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:57.348088 24261 ts_tablet_manager.cc:1428] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20260807 11:08:57.349074 24261 tablet_bootstrap.cc:492] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:57.357206 23510 consensus_peers.cc:487] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:08:57.362962 23030 catalog_manager.cc:4821] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6ebc139f3744d6c9682e3c3ab1ae8dd already in progress: creating tablet
W20260807 11:08:57.364125 23030 catalog_manager.cc:4808] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): delete failed for tablet 069c0bb933ce4d29976205e0286071eb because the tablet was not found. No further retry: Not found: Tablet not found: 069c0bb933ce4d29976205e0286071eb
I20260807 11:08:57.365949 24262 consensus_queue.cc:260] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.366787 24833 raft_consensus.cc:482] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.367236 24833 raft_consensus.cc:504] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.370697 24833 leader_election.cc:288] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:57.371891 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.373124 23745 leader_election.cc:341] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.377336 24266 tablet_bootstrap.cc:654] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.393107 24262 ts_tablet_manager.cc:1428] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.065s user 0.004s sys 0.001s
I20260807 11:08:57.416185 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:57.418007 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 141) took 2961 ms. Trace:
I20260807 11:08:57.418329 24593 rpcz_store.cc:276] 0807 11:08:54.456818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.457842 (+ 1024us) service_pool.cc:227] Handling call
0807 11:08:56.805879 (+2348037us) ts_tablet_manager.cc:1145] Deleting tablet 0071aac25afa4100b98c4811cf3e6b2e
0807 11:08:56.805922 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.168048 (+362126us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.281933 (+113885us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.417948 (+136015us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29435,"tablet-delete.queue_time_us":2347281}
I20260807 11:08:57.419379 24593 tablet_replica.cc:330] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:57.420053 24593 raft_consensus.cc:2229] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:57.420445 24593 raft_consensus.cc:2258] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:57.421379 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 0071aac25afa4100b98c4811cf3e6b2e (table default.Table_980e69ceeabe4770af78e53803d0bf9a [id=2353f55fa7e149748a100664634353bb]) successfully deleted
I20260807 11:08:57.420449 24261 tablet_bootstrap.cc:654] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:57.425215 23745 leader_election.cc:341] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.425599 23745 leader_election.cc:302] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.424378 24593 ts_tablet_manager.cc:1905] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:57.431617 24833 raft_consensus.cc:2726] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:08:57.432255 23507 consensus_peers.cc:487] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5eaf45dad4a944dab77330db6fc53222. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:57.438514 24852 raft_consensus.cc:504] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.439667 24949 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.440752 24852 leader_election.cc:288] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:57.442461 23507 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
I20260807 11:08:57.440297 24949 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:57.446372 23187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 4 candidate_status { last_received { term: 2 index: 258 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:57.446740 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ce7963b93094c27b9e25308e68be630" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:57.447294 24057 raft_consensus.cc:3037] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:57.447217 23187 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e598bda106e4ec181b53fc7f305c822 in term 3.
I20260807 11:08:57.448590 23030 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822; no voters:
I20260807 11:08:57.457140 24262 tablet_bootstrap.cc:492] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:57.459071 24261 tablet_bootstrap.cc:492] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:57.459471 24261 ts_tablet_manager.cc:1397] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.111s user 0.011s sys 0.002s
I20260807 11:08:57.460747 24057 raft_consensus.cc:2454] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:57.461694 24261 raft_consensus.cc:348] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.462318 24261 raft_consensus.cc:374] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.462549 24261 raft_consensus.cc:729] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.463164 23510 leader_election.cc:302] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:57.464250 24852 raft_consensus.cc:2781] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:57.465744 24852 raft_consensus.cc:686] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:57.466554 24852 consensus_queue.cc:237] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.470170 24261 consensus_queue.cc:260] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.470726 24844 consensus_queue.cc:1035] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:57.472900 24593 ts_tablet_manager.cc:1918] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:57.473241 24593 log.cc:1196] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/8a2df15b35bd435baaf95a708ec85a37
I20260807 11:08:57.473886 24593 ts_tablet_manager.cc:1939] T 8a2df15b35bd435baaf95a708ec85a37 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:57.474570 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 140) took 3037 ms. Trace:
I20260807 11:08:57.474882 24593 rpcz_store.cc:276] 0807 11:08:54.436898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.665036 (+228138us) service_pool.cc:227] Handling call
0807 11:08:57.419241 (+2754205us) ts_tablet_manager.cc:1145] Deleting tablet 8a2df15b35bd435baaf95a708ec85a37
0807 11:08:57.419281 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.438337 (+ 19056us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.472671 (+ 34334us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.474518 (+ 1847us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2753495}
I20260807 11:08:57.480772 24675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 4 candidate_status { last_received { term: 2 index: 258 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:57.487402 24949 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:57.488495 24949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 11:08:57.485353 24261 ts_tablet_manager.cc:1428] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260807 11:08:57.491768 24261 tablet_bootstrap.cc:492] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:57.493275 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:57.494419 24593 tablet_replica.cc:330] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:57.495260 24593 raft_consensus.cc:2229] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 11:08:57.495428 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 46918.6us
W20260807 11:08:57.496263 23030 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6ce7963b93094c27b9e25308e68be630 (table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ce7963b93094c27b9e25308e68be630 consensus state has no leader
I20260807 11:08:57.498747 24949 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:57.499569 24949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 3 FOLLOWER]: Advancing to term 4
I20260807 11:08:57.502107 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 8a2df15b35bd435baaf95a708ec85a37 (table default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]) successfully deleted
I20260807 11:08:57.513679 24593 raft_consensus.cc:2258] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:57.515439 24593 ts_tablet_manager.cc:1905] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:57.532467 24261 tablet_bootstrap.cc:654] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.532601 24266 tablet_bootstrap.cc:492] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:57.530265 24262 tablet_bootstrap.cc:654] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.534971 24266 ts_tablet_manager.cc:1397] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.186s user 0.011s sys 0.002s
W20260807 11:08:57.545178 23510 consensus_peers.cc:487] T 95fc220a912543eb8f43d6379795ca03 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:57.553490 24266 raft_consensus.cc:348] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.555444 24266 raft_consensus.cc:374] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.555716 24266 raft_consensus.cc:729] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.540912 24949 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:57.556298 24266 consensus_queue.cc:260] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.569681 24593 ts_tablet_manager.cc:1918] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:57.570776 23187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 4 candidate_status { last_received { term: 2 index: 258 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928"
I20260807 11:08:57.571038 24593 log.cc:1196] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/069c0bb933ce4d29976205e0286071eb
I20260807 11:08:57.571312 23187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 3 FOLLOWER]: Advancing to term 4
I20260807 11:08:57.572901 24593 ts_tablet_manager.cc:1939] T 069c0bb933ce4d29976205e0286071eb P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:57.573627 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 145) took 2932 ms. Trace:
I20260807 11:08:57.573910 24593 rpcz_store.cc:276] 0807 11:08:54.640775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.666717 (+ 25942us) service_pool.cc:227] Handling call
0807 11:08:57.494268 (+2827551us) ts_tablet_manager.cc:1145] Deleting tablet 069c0bb933ce4d29976205e0286071eb
0807 11:08:57.494310 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.522373 (+ 28063us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.569442 (+ 47069us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.573576 (+ 4134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17910,"tablet-delete.queue_time_us":2826967}
I20260807 11:08:57.575417 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 069c0bb933ce4d29976205e0286071eb (table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]) successfully deleted
I20260807 11:08:57.580642 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 150) took 2692 ms. Trace:
I20260807 11:08:57.588338 24593 rpcz_store.cc:276] 0807 11:08:54.887888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.888038 (+ 150us) service_pool.cc:227] Handling call
0807 11:08:57.580291 (+2692253us) ts_tablet_manager.cc:1145] Deleting tablet 26e0c103c9724de18cf95897f33a101a
0807 11:08:57.580334 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.580582 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2691530}
W20260807 11:08:57.589510 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 26e0c103c9724de18cf95897f33a101a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26e0c103c9724de18cf95897f33a101a already in progress: creating tablet
I20260807 11:08:57.592365 24261 tablet_bootstrap.cc:492] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:57.592765 24261 ts_tablet_manager.cc:1397] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.011s
I20260807 11:08:57.594949 24261 raft_consensus.cc:348] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.595595 24261 raft_consensus.cc:374] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.595836 24261 raft_consensus.cc:729] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.596735 24262 tablet_bootstrap.cc:492] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:57.597028 24593 tablet_replica.cc:330] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:57.597144 24262 ts_tablet_manager.cc:1397] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.140s user 0.011s sys 0.001s
I20260807 11:08:57.597752 24593 raft_consensus.cc:2229] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:57.598199 24593 raft_consensus.cc:2258] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:57.600428 24675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e598bda106e4ec181b53fc7f305c822" candidate_term: 4 candidate_status { last_received { term: 2 index: 258 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b"
I20260807 11:08:57.601691 24593 ts_tablet_manager.cc:1905] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:57.604719 24266 ts_tablet_manager.cc:1428] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.069s user 0.004s sys 0.000s
I20260807 11:08:57.604101 24949 leader_election.cc:288] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 4 election: Requested vote from peers 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:57.610951 24261 consensus_queue.cc:260] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.618459 23187 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e598bda106e4ec181b53fc7f305c822 in term 4.
I20260807 11:08:57.626660 24261 ts_tablet_manager.cc:1428] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.034s user 0.008s sys 0.000s
I20260807 11:08:57.628861 23691 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:57.628700 23030 leader_election.cc:302] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822; no voters: b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:08:57.629798 24949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 11:08:57.630342 24949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [term 4 LEADER]: Becoming Leader. State: Replica: 7e598bda106e4ec181b53fc7f305c822, State: Running, Role: LEADER
I20260807 11:08:57.631536 24266 tablet_bootstrap.cc:492] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:57.632886 24262 raft_consensus.cc:348] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.632899 24261 tablet_bootstrap.cc:492] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:57.633560 24262 raft_consensus.cc:374] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.633800 24262 raft_consensus.cc:729] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.634358 24262 consensus_queue.cc:260] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.636925 24949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 257, Committed index: 257, Last appended: 2.258, Last appended by leader: 258, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:57.642225 24844 raft_consensus.cc:482] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.642838 24844 raft_consensus.cc:504] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.647589 24844 leader_election.cc:288] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:57.648589 23507 leader_election.cc:341] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 84c78502f0a5485c9ffe4434c14567e0
I20260807 11:08:57.651800 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c78502f0a5485c9ffe4434c14567e0" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.653404 23510 leader_election.cc:341] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.656402 24262 ts_tablet_manager.cc:1428] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.059s user 0.008s sys 0.000s
I20260807 11:08:57.653997 23510 leader_election.cc:302] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.658144 24262 tablet_bootstrap.cc:492] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:57.668655 24593 ts_tablet_manager.cc:1918] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:57.669057 24593 log.cc:1196] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/b102e85fa1714a29afbc8302be47921e
I20260807 11:08:57.669679 24593 ts_tablet_manager.cc:1939] T b102e85fa1714a29afbc8302be47921e P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:57.669169 24956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e598bda106e4ec181b53fc7f305c822. Latest consensus state: current_term: 4 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:57.670024 24956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: LEADER
I20260807 11:08:57.672096 24261 tablet_bootstrap.cc:654] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.679062 24844 raft_consensus.cc:2726] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.698033 24262 tablet_bootstrap.cc:654] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.703806 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 151) took 2814 ms. Trace:
I20260807 11:08:57.704192 24593 rpcz_store.cc:276] 0807 11:08:54.889119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.889610 (+ 491us) service_pool.cc:227] Handling call
0807 11:08:57.589587 (+2699977us) ts_tablet_manager.cc:1145] Deleting tablet b102e85fa1714a29afbc8302be47921e
0807 11:08:57.596913 (+ 7326us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.625475 (+ 28562us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.668406 (+ 42931us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.703741 (+ 35335us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2699187}
I20260807 11:08:57.705459 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 152) took 2755 ms. Trace:
I20260807 11:08:57.705758 24593 rpcz_store.cc:276] 0807 11:08:54.950186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.951188 (+ 1002us) service_pool.cc:227] Handling call
0807 11:08:57.705116 (+2753928us) ts_tablet_manager.cc:1145] Deleting tablet d78ed82613064935919934df7124d707
0807 11:08:57.705163 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.705411 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2753249}
I20260807 11:08:57.708020 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet b102e85fa1714a29afbc8302be47921e (table default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]) successfully deleted
W20260807 11:08:57.708693 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet d78ed82613064935919934df7124d707 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d78ed82613064935919934df7124d707 already in progress: creating tablet
I20260807 11:08:57.709444 24261 tablet_bootstrap.cc:492] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:57.709877 24261 ts_tablet_manager.cc:1397] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.077s user 0.007s sys 0.006s
I20260807 11:08:57.712096 24266 tablet_bootstrap.cc:654] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.712114 24261 raft_consensus.cc:348] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.712883 24261 raft_consensus.cc:374] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.713173 24261 raft_consensus.cc:729] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.706759 24593 tablet_replica.cc:330] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:57.713820 24261 consensus_queue.cc:260] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.714375 24593 raft_consensus.cc:2229] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:57.715039 24593 pending_rounds.cc:62] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Trying to abort 1 pending ops.
I20260807 11:08:57.715234 24593 pending_rounds.cc:68] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869439876431872 op_type: NO_OP noop_request { }
I20260807 11:08:57.715538 24593 raft_consensus.cc:2866] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:57.715808 24593 raft_consensus.cc:2258] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:57.719101 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:57.724211 24261 ts_tablet_manager.cc:1428] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.014s user 0.004s sys 0.001s
I20260807 11:08:57.726715 24261 tablet_bootstrap.cc:492] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:57.733970 24593 ts_tablet_manager.cc:1905] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:57.752668 24261 tablet_bootstrap.cc:654] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.766149 24844 raft_consensus.cc:482] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.766615 24844 raft_consensus.cc:504] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.767187 24593 ts_tablet_manager.cc:1918] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:57.767619 24593 log.cc:1196] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/6ce7963b93094c27b9e25308e68be630
I20260807 11:08:57.768390 24593 ts_tablet_manager.cc:1939] T 6ce7963b93094c27b9e25308e68be630 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:57.768453 24844 leader_election.cc:288] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:57.769865 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738da1d000b4434cb194d91fea4cc6a5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:57.770375 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 153) took 2712 ms. Trace:
I20260807 11:08:57.770681 24593 rpcz_store.cc:276] 0807 11:08:55.058020 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.058473 (+ 453us) service_pool.cc:227] Handling call
0807 11:08:57.706613 (+2648140us) ts_tablet_manager.cc:1145] Deleting tablet 6ce7963b93094c27b9e25308e68be630
0807 11:08:57.706653 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.748665 (+ 42012us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.766967 (+ 18302us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.770318 (+ 3351us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2647573}
I20260807 11:08:57.771917 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 6ce7963b93094c27b9e25308e68be630 (table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9]) successfully deleted
W20260807 11:08:57.772006 23510 leader_election.cc:341] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.773777 24261 tablet_bootstrap.cc:492] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:57.774190 24261 ts_tablet_manager.cc:1397] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.004s
I20260807 11:08:57.776396 24261 raft_consensus.cc:348] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.777267 24261 raft_consensus.cc:374] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.777547 24261 raft_consensus.cc:729] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.778201 24261 consensus_queue.cc:260] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.780774 24261 ts_tablet_manager.cc:1428] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 11:08:57.788569 24261 tablet_bootstrap.cc:492] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:57.791218 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 154) took 2661 ms. Trace:
I20260807 11:08:57.791520 24593 rpcz_store.cc:276] 0807 11:08:55.130298 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.140575 (+ 10277us) service_pool.cc:227] Handling call
0807 11:08:57.790716 (+2650141us) ts_tablet_manager.cc:1145] Deleting tablet 7a7ccf34faf345998028f67921927f0e
0807 11:08:57.790916 (+ 200us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.791158 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2645609}
I20260807 11:08:57.794106 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738da1d000b4434cb194d91fea4cc6a5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:57.795745 23844 raft_consensus.cc:2454] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:57.797731 23507 leader_election.cc:302] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:57.798408 24261 tablet_bootstrap.cc:654] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:57.798833 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 7a7ccf34faf345998028f67921927f0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a7ccf34faf345998028f67921927f0e already in progress: creating tablet
I20260807 11:08:57.798880 24844 raft_consensus.cc:2781] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:57.799203 24844 raft_consensus.cc:482] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:57.799502 24844 raft_consensus.cc:3037] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:57.800011 24593 tablet_replica.cc:330] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:57.800827 24593 raft_consensus.cc:2229] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:57.801259 24593 raft_consensus.cc:2258] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:57.803071 24593 ts_tablet_manager.cc:1905] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:57.827375 24833 raft_consensus.cc:482] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.827987 24833 raft_consensus.cc:504] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.830564 24833 leader_election.cc:288] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:57.836254 24833 raft_consensus.cc:482] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.836108 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:57.836158 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.837985 23745 leader_election.cc:341] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:57.838589 23745 leader_election.cc:341] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.838831 24266 tablet_bootstrap.cc:492] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:57.839238 24266 ts_tablet_manager.cc:1397] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.208s user 0.008s sys 0.004s
I20260807 11:08:57.836650 24833 raft_consensus.cc:504] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.841463 24266 raft_consensus.cc:348] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.841820 24833 leader_election.cc:288] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:57.842098 24266 raft_consensus.cc:374] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.842339 24266 raft_consensus.cc:729] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.842265 23745 leader_election.cc:302] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.843019 24266 consensus_queue.cc:260] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.844525 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.847084 23745 leader_election.cc:341] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.847597 24833 raft_consensus.cc:2726] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.844270 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:57.842810 24593 ts_tablet_manager.cc:1918] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:08:57.849543 24593 log.cc:1196] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/9fc42a1f14754b2fadd8eb5337b87057
I20260807 11:08:57.850253 24593 ts_tablet_manager.cc:1939] T 9fc42a1f14754b2fadd8eb5337b87057 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
W20260807 11:08:57.850497 23745 leader_election.cc:341] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.850824 23745 leader_election.cc:302] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.844388 24852 raft_consensus.cc:482] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.851598 24852 raft_consensus.cc:504] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.851980 24833 raft_consensus.cc:2726] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.852187 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 155) took 2623 ms. Trace:
I20260807 11:08:57.852480 24593 rpcz_store.cc:276] 0807 11:08:55.228680 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.228846 (+ 166us) service_pool.cc:227] Handling call
0807 11:08:57.799855 (+2571009us) ts_tablet_manager.cc:1145] Deleting tablet 9fc42a1f14754b2fadd8eb5337b87057
0807 11:08:57.799902 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.824539 (+ 24637us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.842562 (+ 18023us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.852133 (+ 9571us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2570456}
I20260807 11:08:57.853497 24852 leader_election.cc:288] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:57.853776 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 9fc42a1f14754b2fadd8eb5337b87057 (table default.Table_06348463068444bfa120534ced7a9e25 [id=02196e29e7f34f2cb49d83c13053ca2d]) successfully deleted
I20260807 11:08:57.854135 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:57.854959 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:08:57.855458 23510 leader_election.cc:341] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.855615 23844 raft_consensus.cc:2454] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:57.856716 23507 leader_election.cc:302] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:57.858242 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:57.813418 24844 raft_consensus.cc:504] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.861953 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738da1d000b4434cb194d91fea4cc6a5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:57.862285 24262 tablet_bootstrap.cc:492] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:57.862620 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 159) took 2519 ms. Trace:
I20260807 11:08:57.862812 24262 ts_tablet_manager.cc:1397] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.205s user 0.009s sys 0.001s
W20260807 11:08:57.863163 23510 leader_election.cc:341] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.862960 24593 rpcz_store.cc:276] 0807 11:08:55.343419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.343535 (+ 116us) service_pool.cc:227] Handling call
0807 11:08:57.862302 (+2518767us) ts_tablet_manager.cc:1145] Deleting tablet 573b681662bc409aa36ccc65e14e9841
0807 11:08:57.862343 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.862568 (+ 225us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2518053}
I20260807 11:08:57.863992 24852 raft_consensus.cc:2781] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:57.864305 24852 raft_consensus.cc:482] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:57.864598 24852 raft_consensus.cc:3037] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:57.865144 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 573b681662bc409aa36ccc65e14e9841 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 573b681662bc409aa36ccc65e14e9841 already in progress: creating tablet
I20260807 11:08:57.871333 24937 raft_consensus.cc:482] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.871778 24937 raft_consensus.cc:504] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.872594 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 161) took 2456 ms. Trace:
I20260807 11:08:57.872922 24593 rpcz_store.cc:276] 0807 11:08:55.416465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.418957 (+ 2492us) service_pool.cc:227] Handling call
0807 11:08:57.872280 (+2453323us) ts_tablet_manager.cc:1145] Deleting tablet c12bb5a459df41e0b0eb87534cb5959a
0807 11:08:57.872319 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.872543 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2452816}
I20260807 11:08:57.873661 24937 leader_election.cc:288] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:08:57.874039 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet c12bb5a459df41e0b0eb87534cb5959a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c12bb5a459df41e0b0eb87534cb5959a already in progress: creating tablet
I20260807 11:08:57.875479 24958 raft_consensus.cc:482] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.875453 24262 raft_consensus.cc:348] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.876158 24262 raft_consensus.cc:374] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.875862 24958 raft_consensus.cc:504] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.876415 24262 raft_consensus.cc:729] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.876458 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2013df97d54d43aaa844154c200a5a4f" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:57.877036 24262 consensus_queue.cc:260] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.877681 24958 leader_election.cc:288] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:57.877767 23745 leader_election.cc:341] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.877774 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 166) took 2296 ms. Trace:
I20260807 11:08:57.878086 24593 rpcz_store.cc:276] 0807 11:08:55.581626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.582727 (+ 1101us) service_pool.cc:227] Handling call
0807 11:08:57.877469 (+2294742us) ts_tablet_manager.cc:1145] Deleting tablet 11c31c37cb2a4d1d8396a79de7d2493c
0807 11:08:57.877512 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.877726 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2293861}
W20260807 11:08:57.879207 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 11c31c37cb2a4d1d8396a79de7d2493c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c31c37cb2a4d1d8396a79de7d2493c already in progress: creating tablet
I20260807 11:08:57.879627 24262 ts_tablet_manager.cc:1428] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.016s user 0.004s sys 0.002s
I20260807 11:08:57.879417 24852 raft_consensus.cc:504] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.880728 24262 tablet_bootstrap.cc:492] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:57.886113 24262 tablet_bootstrap.cc:654] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.888689 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 167) took 2263 ms. Trace:
I20260807 11:08:57.889020 24593 rpcz_store.cc:276] 0807 11:08:55.625175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:55.625328 (+ 153us) service_pool.cc:227] Handling call
0807 11:08:57.887808 (+2262480us) ts_tablet_manager.cc:1145] Deleting tablet 81f0b6867c524174a48a92758e566a95
0807 11:08:57.887849 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.888635 (+ 786us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261798}
I20260807 11:08:57.889779 24846 raft_consensus.cc:482] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:08:57.890244 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet 81f0b6867c524174a48a92758e566a95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f0b6867c524174a48a92758e566a95 already in progress: creating tablet
I20260807 11:08:57.890268 24846 raft_consensus.cc:504] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:57.890884 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ac76be04eca4d7d9d7f0cf6956fd56a" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:57.891294 24593 tablet_replica.cc:330] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:57.891446 24055 raft_consensus.cc:2454] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:57.891947 24593 raft_consensus.cc:2229] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:08:57.892164 24846 leader_election.cc:288] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:57.892443 24593 raft_consensus.cc:2258] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:57.892338 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:57.893774 23954 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: d5260c798aa645e5becf393f06528f87
I20260807 11:08:57.895187 24261 tablet_bootstrap.cc:492] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:57.895570 24261 ts_tablet_manager.cc:1397] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.107s user 0.011s sys 0.017s
I20260807 11:08:57.896018 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2013df97d54d43aaa844154c200a5a4f" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:57.898488 23951 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: d5260c798aa645e5becf393f06528f87
I20260807 11:08:57.898824 23951 leader_election.cc:302] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:57.899462 24846 raft_consensus.cc:2726] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.899179 24261 raft_consensus.cc:348] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.899821 24261 raft_consensus.cc:374] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.900156 24261 raft_consensus.cc:729] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.900880 24261 consensus_queue.cc:260] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:57.901388 23507 leader_election.cc:341] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 2ac76be04eca4d7d9d7f0cf6956fd56a
I20260807 11:08:57.903076 24593 ts_tablet_manager.cc:1905] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:57.909898 24261 ts_tablet_manager.cc:1428] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260807 11:08:57.914513 24261 tablet_bootstrap.cc:492] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:57.921181 23510 leader_election.cc:302] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:57.922041 24958 raft_consensus.cc:2781] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:57.922389 24958 raft_consensus.cc:482] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 11:08:57.922636 23745 leader_election.cc:341] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.922739 24958 raft_consensus.cc:3037] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:57.923154 23745 leader_election.cc:302] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:57.923854 24937 raft_consensus.cc:2726] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:57.924212 24266 ts_tablet_manager.cc:1428] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.085s user 0.002s sys 0.004s
W20260807 11:08:57.922384 23510 leader_election.cc:341] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:57.933409 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "738da1d000b4434cb194d91fea4cc6a5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:57.933964 23844 raft_consensus.cc:3037] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:57.930601 24958 raft_consensus.cc:504] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.937726 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:57.938457 23841 raft_consensus.cc:3037] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:57.939073 23507 leader_election.cc:341] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 2ac76be04eca4d7d9d7f0cf6956fd56a
I20260807 11:08:57.939514 24852 leader_election.cc:288] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:57.939980 24958 leader_election.cc:288] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:57.943909 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ac76be04eca4d7d9d7f0cf6956fd56a" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:57.944464 24057 raft_consensus.cc:3037] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:57.945201 24266 tablet_bootstrap.cc:492] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:57.949898 24261 tablet_bootstrap.cc:654] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.957089 24057 raft_consensus.cc:2454] T 2ac76be04eca4d7d9d7f0cf6956fd56a P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:57.958099 24958 raft_consensus.cc:482] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:57.958547 24958 raft_consensus.cc:504] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:57.961508 24262 tablet_bootstrap.cc:492] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:57.962052 24262 ts_tablet_manager.cc:1397] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.082s user 0.019s sys 0.007s
W20260807 11:08:57.962117 23507 leader_election.cc:341] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 10f6d2989e09466aaa374575a11f40e3
I20260807 11:08:57.963074 24958 leader_election.cc:288] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:57.964443 24262 raft_consensus.cc:348] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.965072 24262 raft_consensus.cc:374] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:57.965324 24262 raft_consensus.cc:729] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:57.972527 23841 raft_consensus.cc:2454] T dde5287f17a944708d7678c57bf37bf9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:57.973694 23507 leader_election.cc:302] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:57.974411 24958 raft_consensus.cc:2781] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:57.975138 24262 consensus_queue.cc:260] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.976020 24958 raft_consensus.cc:686] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:57.976933 24844 leader_election.cc:288] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:57.965610 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f6d2989e09466aaa374575a11f40e3" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:57.977705 24058 raft_consensus.cc:2454] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:57.979105 23510 leader_election.cc:302] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:57.980091 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:57.980181 23510 leader_election.cc:302] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:57.980924 24852 raft_consensus.cc:2781] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:57.976826 24958 consensus_queue.cc:237] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:57.984535 24844 raft_consensus.cc:2781] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:57.984930 24844 raft_consensus.cc:482] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:57.985301 24844 raft_consensus.cc:3037] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:57.985522 24262 ts_tablet_manager.cc:1428] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.023s user 0.005s sys 0.001s
I20260807 11:08:57.986582 24262 tablet_bootstrap.cc:492] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:57.987257 24266 tablet_bootstrap.cc:654] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:57.990249 23844 raft_consensus.cc:2454] T 738da1d000b4434cb194d91fea4cc6a5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:57.994812 24593 ts_tablet_manager.cc:1918] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:57.995200 24593 log.cc:1196] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/b5a2ef08f9524cb9bc89a7e4b9dcb5d2
I20260807 11:08:58.001230 24262 tablet_bootstrap.cc:654] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.004130 23913 heartbeater.cc:347] Connected to a master server at 127.22.115.252:40555
I20260807 11:08:58.009189 23507 leader_election.cc:302] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:58.015832 24852 raft_consensus.cc:686] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:58.016829 24852 consensus_queue.cc:237] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.024228 24978 raft_consensus.cc:2781] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:58.029816 24262 tablet_bootstrap.cc:492] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:58.029961 24261 tablet_bootstrap.cc:492] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:58.030239 24262 ts_tablet_manager.cc:1397] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.003s
I20260807 11:08:58.030339 24261 ts_tablet_manager.cc:1397] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.120s user 0.011s sys 0.003s
I20260807 11:08:58.027858 24266 tablet_bootstrap.cc:492] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:58.031582 24266 ts_tablet_manager.cc:1397] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.002s
I20260807 11:08:58.032593 24262 raft_consensus.cc:348] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.033253 24262 raft_consensus.cc:374] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.033514 24262 raft_consensus.cc:729] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.034116 24266 raft_consensus.cc:348] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.034076 24262 consensus_queue.cc:260] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.034832 24266 raft_consensus.cc:374] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.035143 24266 raft_consensus.cc:729] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.036326 24266 consensus_queue.cc:260] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.037957 24593 ts_tablet_manager.cc:1939] T b5a2ef08f9524cb9bc89a7e4b9dcb5d2 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:58.038762 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 176) took 1748 ms. Trace:
I20260807 11:08:58.039093 24593 rpcz_store.cc:276] 0807 11:08:56.290631 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:56.290736 (+ 105us) service_pool.cc:227] Handling call
0807 11:08:57.891157 (+1600421us) ts_tablet_manager.cc:1145] Deleting tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2
0807 11:08:57.891195 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:57.953346 (+ 62151us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:57.970649 (+ 17303us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:58.038712 (+ 68063us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1599007}
I20260807 11:08:58.040243 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet b5a2ef08f9524cb9bc89a7e4b9dcb5d2 (table default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]) successfully deleted
I20260807 11:08:58.044287 24978 raft_consensus.cc:686] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:58.032609 24261 raft_consensus.cc:348] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.045295 24261 raft_consensus.cc:374] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.045545 24261 raft_consensus.cc:729] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.046726 24593 tablet_replica.cc:330] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:08:58.048826 24593 raft_consensus.cc:2229] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:08:58.049612 24593 pending_rounds.cc:62] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Trying to abort 1 pending ops.
I20260807 11:08:58.049837 24593 pending_rounds.cc:68] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315869436204875776 op_type: NO_OP noop_request { }
I20260807 11:08:58.050202 24593 raft_consensus.cc:2866] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 11:08:58.050505 24593 raft_consensus.cc:2258] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:08:58.051800 24262 ts_tablet_manager.cc:1428] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.021s user 0.001s sys 0.005s
I20260807 11:08:58.053644 24978 consensus_queue.cc:237] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.060334 24844 raft_consensus.cc:504] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.066324 24261 consensus_queue.cc:260] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.068674 24261 ts_tablet_manager.cc:1428] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.038s user 0.002s sys 0.002s
I20260807 11:08:58.069553 24261 tablet_bootstrap.cc:492] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:58.071884 24262 tablet_bootstrap.cc:492] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:08:58.072091 23507 leader_election.cc:341] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 10f6d2989e09466aaa374575a11f40e3
I20260807 11:08:58.073074 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f6d2989e09466aaa374575a11f40e3" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:58.073678 24058 raft_consensus.cc:3037] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.078152 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:58.081190 24262 tablet_bootstrap.cc:654] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.083202 24058 raft_consensus.cc:2454] T 10f6d2989e09466aaa374575a11f40e3 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:58.084300 23510 leader_election.cc:302] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:58.085079 24852 raft_consensus.cc:2781] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:58.085587 24852 raft_consensus.cc:686] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:58.086374 24852 consensus_queue.cc:237] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.091159 24844 leader_election.cc:288] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.093828 24593 ts_tablet_manager.cc:1905] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:08:58.104239 24262 tablet_bootstrap.cc:492] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:58.107383 24262 ts_tablet_manager.cc:1397] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.006s
I20260807 11:08:58.109921 24262 raft_consensus.cc:348] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.115690 24266 ts_tablet_manager.cc:1428] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.084s user 0.002s sys 0.003s
I20260807 11:08:58.121641 24261 tablet_bootstrap.cc:654] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.110577 24262 raft_consensus.cc:374] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.125785 24262 raft_consensus.cc:729] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.126816 24262 consensus_queue.cc:260] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.137415 24266 tablet_bootstrap.cc:492] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:58.137418 24262 ts_tablet_manager.cc:1428] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.030s user 0.001s sys 0.004s
I20260807 11:08:58.154086 24593 ts_tablet_manager.cc:1918] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:08:58.156720 24593 log.cc:1196] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/5eaf45dad4a944dab77330db6fc53222
I20260807 11:08:58.157600 24852 raft_consensus.cc:482] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.158087 24852 raft_consensus.cc:504] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.159997 24852 leader_election.cc:288] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.161924 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cb221021564d66bfecf5cd91bcec5c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:58.163335 23510 leader_election.cc:341] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.164484 24593 ts_tablet_manager.cc:1939] T 5eaf45dad4a944dab77330db6fc53222 P 8a668588fabb4a9eba107cd6020f1e93: Deleting consensus metadata
I20260807 11:08:58.172875 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 175) took 1882 ms. Trace:
I20260807 11:08:58.174139 24593 rpcz_store.cc:276] 0807 11:08:56.290321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:56.290949 (+ 628us) service_pool.cc:227] Handling call
0807 11:08:58.046581 (+1755632us) ts_tablet_manager.cc:1145] Deleting tablet 5eaf45dad4a944dab77330db6fc53222
0807 11:08:58.046623 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:58.128963 (+ 82340us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:58.153833 (+ 24870us) tablet_metadata.cc:641] Metadata flushed
0807 11:08:58.172817 (+ 18984us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1753494}
I20260807 11:08:58.176127 23030 catalog_manager.cc:4841] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): tablet 5eaf45dad4a944dab77330db6fc53222 (table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63]) successfully deleted
I20260807 11:08:58.177284 24593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52302 (request call id 178) took 1391 ms. Trace:
I20260807 11:08:58.178437 24593 rpcz_store.cc:276] 0807 11:08:56.785520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:56.786951 (+ 1431us) service_pool.cc:227] Handling call
0807 11:08:58.176975 (+1390024us) ts_tablet_manager.cc:1145] Deleting tablet a6ebc139f3744d6c9682e3c3ab1ae8dd
0807 11:08:58.177015 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 11:08:58.177237 (+ 222us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1377941}
W20260807 11:08:58.180361 23030 catalog_manager.cc:4821] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): delete failed for tablet a6ebc139f3744d6c9682e3c3ab1ae8dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6ebc139f3744d6c9682e3c3ab1ae8dd already in progress: creating tablet
I20260807 11:08:58.188439 24261 tablet_bootstrap.cc:492] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:58.188961 24261 ts_tablet_manager.cc:1397] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.120s user 0.018s sys 0.001s
I20260807 11:08:58.191210 24261 raft_consensus.cc:348] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.142354 24266 tablet_bootstrap.cc:654] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.196291 23187 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Refusing update from remote peer 7e598bda106e4ec181b53fc7f305c822: Log matching property violated. Preceding OpId in replica: term: 2 index: 257. Preceding OpId from leader: term: 4 index: 259. (index mismatch)
I20260807 11:08:58.198169 24956 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 259, Last known committed idx: 250, Time since last communication: 0.000s
I20260807 11:08:58.200773 24261 raft_consensus.cc:374] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.201043 24261 raft_consensus.cc:729] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
W20260807 11:08:58.202872 23507 leader_election.cc:341] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 64cb221021564d66bfecf5cd91bcec5c
I20260807 11:08:58.203240 23507 leader_election.cc:302] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:58.202069 24261 consensus_queue.cc:260] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.204962 24846 raft_consensus.cc:482] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.205394 24262 tablet_bootstrap.cc:492] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:58.205367 24846 raft_consensus.cc:504] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.207031 24978 raft_consensus.cc:2726] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.207175 24846 leader_election.cc:288] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:58.211373 24937 raft_consensus.cc:482] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.211805 24937 raft_consensus.cc:504] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.213196 24261 ts_tablet_manager.cc:1428] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260807 11:08:58.213575 24937 leader_election.cc:288] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:58.213968 24261 tablet_bootstrap.cc:492] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:58.214888 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:58.217032 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95fc220a912543eb8f43d6379795ca03" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:58.219516 23951 leader_election.cc:302] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:58.218619 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:58.221174 24119 heartbeater.cc:503] Master 127.22.115.252:40555 was elected leader, sending a full tablet report...
I20260807 11:08:58.221304 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:58.222230 23745 leader_election.cc:341] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:58.223392 23745 leader_election.cc:341] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.223719 23745 leader_election.cc:302] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:58.227875 24846 raft_consensus.cc:2726] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.229657 24937 raft_consensus.cc:2726] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.235425 24262 tablet_bootstrap.cc:654] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.256521 24266 tablet_bootstrap.cc:492] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:58.256944 24266 ts_tablet_manager.cc:1397] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.122s user 0.008s sys 0.000s
I20260807 11:08:58.268198 24266 raft_consensus.cc:348] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.268945 24266 raft_consensus.cc:374] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.269196 24266 raft_consensus.cc:729] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.269757 24266 consensus_queue.cc:260] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.284169 24261 tablet_bootstrap.cc:654] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.306170 24262 tablet_bootstrap.cc:492] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:58.306596 24262 ts_tablet_manager.cc:1397] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.101s user 0.009s sys 0.013s
I20260807 11:08:58.312912 24993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e598bda106e4ec181b53fc7f305c822. Latest consensus state: current_term: 4 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:58.314133 24993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:58.315629 24262 raft_consensus.cc:348] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:58.316270 24262 raft_consensus.cc:374] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.316515 24262 raft_consensus.cc:729] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.318941 24852 raft_consensus.cc:482] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.319612 24261 tablet_bootstrap.cc:492] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:58.319401 24852 raft_consensus.cc:504] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.320008 24261 ts_tablet_manager.cc:1397] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.106s user 0.010s sys 0.003s
I20260807 11:08:58.321456 24852 leader_election.cc:288] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.323760 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:58.324364 23844 raft_consensus.cc:2454] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:58.325928 23507 leader_election.cc:302] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:58.328847 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:58.330302 23510 leader_election.cc:341] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.331323 24852 raft_consensus.cc:2781] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:58.331758 24852 raft_consensus.cc:482] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:58.333348 24852 raft_consensus.cc:3037] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.333734 24266 ts_tablet_manager.cc:1428] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.077s user 0.007s sys 0.000s
I20260807 11:08:58.339506 24058 raft_consensus.cc:3037] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.340968 24978 raft_consensus.cc:482] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.341427 24978 raft_consensus.cc:504] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.342515 24939 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e598bda106e4ec181b53fc7f305c822. Latest consensus state: current_term: 2 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:58.343433 24939 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:58.343406 24978 leader_election.cc:288] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.344005 24940 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:08:58.344468 24940 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:58.347084 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce42b3bd73242418f510c5b83259238" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:58.347461 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce42b3bd73242418f510c5b83259238" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:58.348060 23844 raft_consensus.cc:2454] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
W20260807 11:08:58.348510 23510 leader_election.cc:341] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.348294 24986 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:58.349020 24986 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:58.349140 23507 leader_election.cc:302] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:58.351358 24266 tablet_bootstrap.cc:492] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:58.351473 24978 raft_consensus.cc:2781] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:58.352346 24978 raft_consensus.cc:482] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:58.352423 24875 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:58.353188 24875 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:58.353056 24978 raft_consensus.cc:3037] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.366086 25012 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 11:08:58.366053 24852 raft_consensus.cc:504] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.371248 24262 consensus_queue.cc:260] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:58.371943 24940 leader_election.cc:288] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309)
I20260807 11:08:58.373965 24262 ts_tablet_manager.cc:1428] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.067s user 0.009s sys 0.000s
I20260807 11:08:58.381677 24978 raft_consensus.cc:504] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.389461 24993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:58.390233 24993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:58.408025 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:58.408625 23844 raft_consensus.cc:3037] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.408071 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce42b3bd73242418f510c5b83259238" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:58.409236 23841 raft_consensus.cc:3037] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.416581 23841 raft_consensus.cc:2454] T 1ce42b3bd73242418f510c5b83259238 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:58.417658 23507 leader_election.cc:302] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:58.418678 24982 raft_consensus.cc:2781] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:58.419134 24982 raft_consensus.cc:686] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:58.420203 23844 raft_consensus.cc:2454] T b0ee41a2c21548e7961b3884e8c7a4ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:58.419883 24982 consensus_queue.cc:237] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.421180 23507 leader_election.cc:302] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:58.422665 24844 raft_consensus.cc:2781] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:58.423125 24844 raft_consensus.cc:686] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:58.423621 24262 tablet_bootstrap.cc:492] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:58.423817 24844 consensus_queue.cc:237] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.426486 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:58.427830 23510 leader_election.cc:341] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.431872 23041 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:53338 (request call id 235) took 1653 ms. Trace:
I20260807 11:08:58.431788 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ce42b3bd73242418f510c5b83259238" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:58.433005 23510 leader_election.cc:341] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.433486 24852 leader_election.cc:288] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.388259 24261 raft_consensus.cc:348] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.434422 24261 raft_consensus.cc:374] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.432178 23041 rpcz_store.cc:276] 0807 11:08:56.778017 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:56.779428 (+ 1411us) service_pool.cc:227] Handling call
0807 11:08:56.788229 (+ 8801us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b54000217d4. stack: 00007fda4c4f7033 00007fda4c4f6f30 00007fda4c078534 00000000004db2b4 00000000004db249 00007fda53403af0 00007fda53486f2a 00007fda55352d6c 00007fda5544e156 00007fda52f8b034 00007fda52f8afc2 00007fda52f8aef1 00007fda52f8ae6c 00007fda52f8a122 00007fda5122d94c 00007fda5122cd86
0807 11:08:56.790358 (+ 2129us) catalog_manager.cc:2075] Acquired catalog manager lock
0807 11:08:56.793908 (+ 3550us) catalog_manager.cc:2121] Created new table and tablet info
0807 11:08:58.431179 (+1637271us) catalog_manager.cc:2181] Wrote table and tablets to system table
0807 11:08:58.431525 (+ 346us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0807 11:08:58.431793 (+ 268us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:56.807303 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:08:56.807644 (+ 341us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:08:56.807667 (+ 23us) write_op.cc:435] Acquired schema lock
0807 11:08:56.807678 (+ 11us) tablet.cc:660] Decoding operations
0807 11:08:56.807938 (+ 260us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:08:56.807976 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0807 11:08:56.807996 (+ 20us) tablet.cc:683] Acquiring locks for 2 operations
0807 11:08:56.808181 (+ 185us) tablet.cc:699] Row locks acquired
0807 11:08:56.808194 (+ 13us) write_op.cc:260] PREPARE: finished
0807 11:08:56.808298 (+ 104us) write_op.cc:270] Start()
0807 11:08:56.808376 (+ 78us) write_op.cc:276] Timestamp: P: 1786100936808255 usec, L: 0
0807 11:08:56.808390 (+ 14us) op_driver.cc:331] REPLICATION: starting
0807 11:08:56.808870 (+ 480us) log.cc:842] Serialized 433 byte log entry
0807 11:08:58.363653 (+1554783us) op_driver.cc:444] REPLICATION: finished
0807 11:08:58.427066 (+ 63413us) write_op.cc:301] APPLY: starting
0807 11:08:58.427126 (+ 60us) tablet.cc:1365] starting BulkCheckPresence
0807 11:08:58.427228 (+ 102us) tablet.cc:1368] finished BulkCheckPresence
0807 11:08:58.427342 (+ 114us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:08:58.427771 (+ 429us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:08:58.429903 (+ 2132us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 11:08:58.429951 (+ 48us) write_op.cc:312] APPLY: finished
0807 11:08:58.430191 (+ 240us) log.cc:842] Serialized 29 byte log entry
0807 11:08:58.430834 (+ 643us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:08:58.430923 (+ 89us) write_op.cc:454] Released schema lock
0807 11:08:58.430953 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":17670400,"child_traces":[["op",{"apply.queue_time_us":63058,"num_ops":2,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":1755,"prepare.run_wall_time_us":1755,"replication_time_us":1555186,"thread_start_us":66434,"threads_started":1}]]}
I20260807 11:08:58.434667 24261 raft_consensus.cc:729] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.435223 24978 leader_election.cc:288] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.435032 24266 tablet_bootstrap.cc:654] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.437054 24261 consensus_queue.cc:260] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.439028 24261 ts_tablet_manager.cc:1428] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.119s user 0.005s sys 0.002s
I20260807 11:08:58.439819 24261 tablet_bootstrap.cc:492] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:58.460331 24261 tablet_bootstrap.cc:654] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.462141 25011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:58.463027 25011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: LEADER
I20260807 11:08:58.457217 24262 tablet_bootstrap.cc:654] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.475389 24675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 2 FOLLOWER]: Advancing to term 4
I20260807 11:08:58.482599 24675 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Refusing update from remote peer 7e598bda106e4ec181b53fc7f305c822: Log matching property violated. Preceding OpId in replica: term: 2 index: 207. Preceding OpId from leader: term: 4 index: 259. (index mismatch)
I20260807 11:08:58.483361 24262 tablet_bootstrap.cc:492] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:58.483775 24262 ts_tablet_manager.cc:1397] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.001s
I20260807 11:08:58.486900 24956 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 259, Last known committed idx: 206, Time since last communication: 0.000s
I20260807 11:08:58.486232 24681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59452 (request call id 0) took 3885 ms. Trace:
I20260807 11:08:58.458423 24643 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" instance_seqno: 1786100918916999) as {username='slave'} at 127.22.115.194:43321; Asking this server to re-register.
I20260807 11:08:58.497493 23913 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:58.502416 24262 raft_consensus.cc:348] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.503113 24262 raft_consensus.cc:374] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.504679 24261 tablet_bootstrap.cc:492] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:58.505137 24261 ts_tablet_manager.cc:1397] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.065s user 0.013s sys 0.002s
I20260807 11:08:58.514724 24261 raft_consensus.cc:348] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.503348 24262 raft_consensus.cc:729] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.516185 24262 consensus_queue.cc:260] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.517315 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 3 candidate_status { last_received { term: 2 index: 207 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:08:58.518111 24262 ts_tablet_manager.cc:1428] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.034s user 0.003s sys 0.002s
I20260807 11:08:58.519064 24262 tablet_bootstrap.cc:492] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:58.527204 24965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 11:08:58.536317 24643 ts_manager.cc:194] Registered new tserver with Master: 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:58.515400 24261 raft_consensus.cc:374] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.541491 24261 raft_consensus.cc:729] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.543604 25039 raft_consensus.cc:482] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.544036 25039 raft_consensus.cc:504] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.546662 25039 leader_election.cc:288] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:58.547266 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:58.547021 24642 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c281254655c84a0496c50045c37b22df" instance_seqno: 1786100921305915) as {username='slave'} at 127.22.115.195:55411; Asking this server to re-register.
W20260807 11:08:58.548429 23745 leader_election.cc:341] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.542160 24261 consensus_queue.cc:260] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.557996 25039 raft_consensus.cc:482] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.558471 25039 raft_consensus.cc:504] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.560631 25039 leader_election.cc:288] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:58.561561 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:58.562682 23745 leader_election.cc:341] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.563721 24261 ts_tablet_manager.cc:1428] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.058s user 0.006s sys 0.001s
I20260807 11:08:58.564167 24262 tablet_bootstrap.cc:654] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.559314 24628 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" instance_seqno: 1786100916332753) as {username='slave'} at 127.22.115.193:60519; Asking this server to re-register.
I20260807 11:08:58.578881 24261 tablet_bootstrap.cc:492] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:58.569453 23691 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:58.577795 24978 raft_consensus.cc:482] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.583055 24978 raft_consensus.cc:504] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.584859 24978 leader_election.cc:288] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.586952 24978 raft_consensus.cc:482] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.587328 24978 raft_consensus.cc:504] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.595021 24978 leader_election.cc:288] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.596313 24261 tablet_bootstrap.cc:654] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.597960 25039 raft_consensus.cc:482] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:08:58.598374 23030 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (table default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2ebf05f3933a433cb7201f6c1f9e11c9 consensus state has no leader
I20260807 11:08:58.598555 25039 raft_consensus.cc:504] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.599172 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cd1107ba80a4dbeaba696a7b7095423" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:58.599958 23844 raft_consensus.cc:2454] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:58.601524 23507 leader_election.cc:302] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:58.602138 25039 leader_election.cc:288] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:58.603443 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:58.604944 23745 leader_election.cc:341] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.605563 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:58.608541 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:58.609337 24119 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:58.610128 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cd1107ba80a4dbeaba696a7b7095423" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:58.612149 23510 leader_election.cc:341] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.612182 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:58.612718 23510 leader_election.cc:341] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:58.613363 23745 leader_election.cc:341] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.613744 23841 raft_consensus.cc:2454] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:58.614137 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:58.615291 23507 leader_election.cc:302] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:58.615355 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:58.616425 24978 raft_consensus.cc:2781] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:58.616923 24978 raft_consensus.cc:482] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:58.617398 24978 raft_consensus.cc:3037] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.613724 23745 leader_election.cc:302] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
W20260807 11:08:58.619910 23745 leader_election.cc:341] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.620261 23745 leader_election.cc:302] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:58.614356 24982 raft_consensus.cc:2781] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:58.620956 24937 raft_consensus.cc:2726] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.621477 24937 raft_consensus.cc:2726] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:08:58.622365 23745 leader_election.cc:341] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.622704 23745 leader_election.cc:302] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:58.621372 24982 raft_consensus.cc:482] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:58.623310 24982 raft_consensus.cc:3037] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.623752 25039 raft_consensus.cc:2726] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.633792 24262 tablet_bootstrap.cc:492] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:58.634220 24262 ts_tablet_manager.cc:1397] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.115s user 0.010s sys 0.002s
W20260807 11:08:58.641527 24135 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.115.254:40237)
I20260807 11:08:58.641270 24262 raft_consensus.cc:348] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.649401 24266 tablet_bootstrap.cc:492] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:58.649839 24266 ts_tablet_manager.cc:1397] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.299s user 0.009s sys 0.000s
I20260807 11:08:58.648190 24262 raft_consensus.cc:374] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.650496 24262 raft_consensus.cc:729] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.652741 24266 raft_consensus.cc:348] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.653388 24266 raft_consensus.cc:374] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.653626 24266 raft_consensus.cc:729] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.652261 24978 raft_consensus.cc:504] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.654701 24262 consensus_queue.cc:260] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.663969 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:58.664633 23841 raft_consensus.cc:3037] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.675093 25028 raft_consensus.cc:482] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.675684 25028 raft_consensus.cc:504] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.679077 24261 tablet_bootstrap.cc:492] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:58.679512 24261 ts_tablet_manager.cc:1397] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.101s user 0.006s sys 0.009s
I20260807 11:08:58.679322 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:58.681154 23745 leader_election.cc:341] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.681661 24261 raft_consensus.cc:348] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.682327 24261 raft_consensus.cc:374] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.682605 24261 raft_consensus.cc:729] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.682693 25028 leader_election.cc:288] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:58.685003 24266 consensus_queue.cc:260] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.686197 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:08:58.687852 23745 leader_election.cc:341] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.688223 23745 leader_election.cc:302] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:58.675752 24262 ts_tablet_manager.cc:1428] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.041s user 0.008s sys 0.002s
I20260807 11:08:58.689863 25028 raft_consensus.cc:2726] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.690109 24266 ts_tablet_manager.cc:1428] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.040s user 0.002s sys 0.005s
I20260807 11:08:58.692121 24266 tablet_bootstrap.cc:492] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:58.696770 23841 raft_consensus.cc:2454] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:58.703830 24266 tablet_bootstrap.cc:654] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.705905 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:58.707556 23510 leader_election.cc:341] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.722133 24978 leader_election.cc:288] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.717022 25028 raft_consensus.cc:482] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.723676 24262 tablet_bootstrap.cc:492] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:58.723237 25028 raft_consensus.cc:504] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:08:58.728166 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:58.728940 25028 leader_election.cc:288] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:58.728307 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:58.731024 23187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 3 candidate_status { last_received { term: 2 index: 207 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:08:58.730255 23507 leader_election.cc:302] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
W20260807 11:08:58.731514 23745 leader_election.cc:341] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:58.732067 23745 leader_election.cc:341] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.732101 24844 raft_consensus.cc:2781] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:58.732380 23745 leader_election.cc:302] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:58.732699 24844 raft_consensus.cc:686] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:58.733089 24575 leader_election.cc:302] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b43b3e5203ee4ac3a23fa1902356994b; no voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822
I20260807 11:08:58.686182 24261 consensus_queue.cc:260] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.733863 24844 consensus_queue.cc:237] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.736539 24266 tablet_bootstrap.cc:492] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:58.736963 24266 ts_tablet_manager.cc:1397] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.000s
I20260807 11:08:58.740029 24266 raft_consensus.cc:348] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.740821 24266 raft_consensus.cc:374] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.741065 24266 raft_consensus.cc:729] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.742897 24266 consensus_queue.cc:260] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.745505 25028 raft_consensus.cc:2726] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.748951 24261 ts_tablet_manager.cc:1428] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.069s user 0.007s sys 0.000s
I20260807 11:08:58.759677 24261 tablet_bootstrap.cc:492] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:58.772637 24266 ts_tablet_manager.cc:1428] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20260807 11:08:58.698740 24982 raft_consensus.cc:504] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.782397 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cd1107ba80a4dbeaba696a7b7095423" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:58.783881 23510 leader_election.cc:341] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.787026 24266 tablet_bootstrap.cc:492] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:58.787348 24982 leader_election.cc:288] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.789902 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cd1107ba80a4dbeaba696a7b7095423" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:58.790692 23841 raft_consensus.cc:3037] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.791574 24262 tablet_bootstrap.cc:654] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.807346 24266 tablet_bootstrap.cc:654] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.817065 24978 consensus_queue.cc:1035] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:58.818101 24058 raft_consensus.cc:3037] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:58.824535 24266 tablet_bootstrap.cc:492] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:58.825126 24266 ts_tablet_manager.cc:1397] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.052s user 0.016s sys 0.000s
I20260807 11:08:58.827600 24266 raft_consensus.cc:348] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.828215 24266 raft_consensus.cc:374] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.828074 24982 consensus_queue.cc:1035] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:58.828461 24266 raft_consensus.cc:729] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.833379 24266 consensus_queue.cc:260] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.835740 24266 ts_tablet_manager.cc:1428] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
I20260807 11:08:58.836529 24266 tablet_bootstrap.cc:492] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:58.838673 24261 tablet_bootstrap.cc:654] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.844553 23841 raft_consensus.cc:2454] T 9cd1107ba80a4dbeaba696a7b7095423 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:58.851517 24266 tablet_bootstrap.cc:654] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.851058 24262 tablet_bootstrap.cc:492] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:58.855731 24262 ts_tablet_manager.cc:1397] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.132s user 0.008s sys 0.008s
I20260807 11:08:58.860805 23507 leader_election.cc:302] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:58.866227 24975 raft_consensus.cc:2781] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:58.866668 24975 raft_consensus.cc:686] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:58.867435 24975 consensus_queue.cc:237] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:58.898132 23507 consensus_peers.cc:487] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ac76be04eca4d7d9d7f0cf6956fd56a. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:58.859297 24262 raft_consensus.cc:348] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.915598 24262 raft_consensus.cc:374] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.915982 24262 raft_consensus.cc:729] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.916821 24262 consensus_queue.cc:260] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.923815 25028 raft_consensus.cc:482] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:58.924239 25028 raft_consensus.cc:504] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.926069 25028 leader_election.cc:288] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.928602 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:58.929836 23745 leader_election.cc:341] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.932116 24266 tablet_bootstrap.cc:492] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:58.932520 24266 ts_tablet_manager.cc:1397] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.096s user 0.011s sys 0.004s
I20260807 11:08:58.933881 24261 tablet_bootstrap.cc:492] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:58.934401 24261 ts_tablet_manager.cc:1397] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.175s user 0.007s sys 0.003s
I20260807 11:08:58.934684 24266 raft_consensus.cc:348] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.936666 24261 raft_consensus.cc:348] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.937289 24261 raft_consensus.cc:374] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.937289 24266 raft_consensus.cc:374] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.937537 24266 raft_consensus.cc:729] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.937744 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:58.938153 24266 consensus_queue.cc:260] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:58.939337 23745 leader_election.cc:341] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:58.939689 23745 leader_election.cc:302] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:58.940642 25028 raft_consensus.cc:2726] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:58.950683 24266 ts_tablet_manager.cc:1428] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
W20260807 11:08:58.957809 23510 consensus_peers.cc:487] T dde5287f17a944708d7678c57bf37bf9 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:58.962702 24266 tablet_bootstrap.cc:492] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:58.937537 24261 raft_consensus.cc:729] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.967748 24266 tablet_bootstrap.cc:654] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.968529 24261 consensus_queue.cc:260] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:58.970517 24261 ts_tablet_manager.cc:1428] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.036s user 0.004s sys 0.000s
I20260807 11:08:58.970222 25063 consensus_queue.cc:1035] T 738da1d000b4434cb194d91fea4cc6a5 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:58.977337 24261 tablet_bootstrap.cc:492] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:58.982791 24261 tablet_bootstrap.cc:654] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:58.982688 24266 tablet_bootstrap.cc:492] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:58.983378 24266 ts_tablet_manager.cc:1397] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.002s
I20260807 11:08:58.987331 24266 raft_consensus.cc:348] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.988659 24266 raft_consensus.cc:374] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:58.990136 24266 raft_consensus.cc:729] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:58.991341 24266 consensus_queue.cc:260] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:58.998373 24262 ts_tablet_manager.cc:1428] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.142s user 0.005s sys 0.000s
I20260807 11:08:58.999784 24266 ts_tablet_manager.cc:1428] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.016s user 0.007s sys 0.001s
I20260807 11:08:59.001258 24266 tablet_bootstrap.cc:492] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:59.011094 24266 tablet_bootstrap.cc:654] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.018093 24262 tablet_bootstrap.cc:492] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:59.025486 24261 tablet_bootstrap.cc:492] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:59.025982 24261 ts_tablet_manager.cc:1397] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.049s user 0.008s sys 0.007s
I20260807 11:08:59.028384 24261 raft_consensus.cc:348] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.028986 24261 raft_consensus.cc:374] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.029210 24261 raft_consensus.cc:729] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.029726 24261 consensus_queue.cc:260] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.031580 24261 ts_tablet_manager.cc:1428] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 11:08:59.033125 24261 tablet_bootstrap.cc:492] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:59.038062 24261 tablet_bootstrap.cc:654] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.064589 24844 consensus_queue.cc:1035] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:59.076056 24844 raft_consensus.cc:482] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.077921 24844 raft_consensus.cc:504] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:59.110086 23507 leader_election.cc:341] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: d78ed82613064935919934df7124d707
I20260807 11:08:59.110167 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d78ed82613064935919934df7124d707" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:59.111603 24262 tablet_bootstrap.cc:654] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:59.111939 23510 leader_election.cc:341] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.112309 23510 leader_election.cc:302] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:08:59.113989 25066 raft_consensus.cc:2726] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:59.120949 24844 leader_election.cc:288] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:58.494796 24681 rpcz_store.cc:276] 0807 11:08:54.575834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:54.576136 (+ 302us) service_pool.cc:227] Handling call
0807 11:08:56.660295 (+2084159us) raft_consensus.cc:1457] Updating replica for 196 ops
0807 11:08:57.295213 (+634918us) raft_consensus.cc:1520] Early marking committed up to index 11
0807 11:08:57.344322 (+ 49109us) raft_consensus.cc:1525] Triggering prepare for 196 ops
0807 11:08:57.344993 (+ 671us) write_op.cc:270] Start()
0807 11:08:57.345128 (+ 135us) write_op.cc:276] Timestamp: P: 1786100923424942 usec, L: 0
0807 11:08:57.384242 (+ 39114us) write_op.cc:270] Start()
0807 11:08:57.384333 (+ 91us) write_op.cc:276] Timestamp: P: 1786100923436127 usec, L: 0
0807 11:08:57.384834 (+ 501us) write_op.cc:270] Start()
0807 11:08:57.384921 (+ 87us) write_op.cc:276] Timestamp: P: 1786100923452076 usec, L: 0
0807 11:08:57.385357 (+ 436us) write_op.cc:270] Start()
0807 11:08:57.385446 (+ 89us) write_op.cc:276] Timestamp: P: 1786100923454089 usec, L: 0
0807 11:08:57.385887 (+ 441us) write_op.cc:270] Start()
0807 11:08:57.385966 (+ 79us) write_op.cc:276] Timestamp: P: 1786100923456264 usec, L: 0
0807 11:08:57.386400 (+ 434us) write_op.cc:270] Start()
0807 11:08:57.386494 (+ 94us) write_op.cc:276] Timestamp: P: 1786100923458165 usec, L: 0
0807 11:08:57.465045 (+ 78551us) write_op.cc:270] Start()
0807 11:08:57.465220 (+ 175us) write_op.cc:276] Timestamp: P: 1786100923530026 usec, L: 0
0807 11:08:57.468502 (+ 3282us) write_op.cc:270] Start()
0807 11:08:57.468596 (+ 94us) write_op.cc:276] Timestamp: P: 1786100923542647 usec, L: 0
0807 11:08:57.478769 (+ 10173us) write_op.cc:270] Start()
0807 11:08:57.483404 (+ 4635us) write_op.cc:276] Timestamp: P: 1786100923546093 usec, L: 0
0807 11:08:57.484137 (+ 733us) write_op.cc:270] Start()
0807 11:08:57.484246 (+ 109us) write_op.cc:276] Timestamp: P: 1786100923651181 usec, L: 0
0807 11:08:57.484887 (+ 641us) write_op.cc:270] Start()
0807 11:08:57.485059 (+ 172us) write_op.cc:276] Timestamp: P: 1786100923714327 usec, L: 0
0807 11:08:57.485857 (+ 798us) write_op.cc:270] Start()
0807 11:08:57.485965 (+ 108us) write_op.cc:276] Timestamp: P: 1786100923755814 usec, L: 0
0807 11:08:57.504503 (+ 18538us) write_op.cc:270] Start()
0807 11:08:57.504611 (+ 108us) write_op.cc:276] Timestamp: P: 1786100923765456 usec, L: 0
0807 11:08:57.526415 (+ 21804us) write_op.cc:270] Start()
0807 11:08:57.526551 (+ 136us) write_op.cc:276] Timestamp: P: 1786100923773049 usec, L: 0
0807 11:08:57.531963 (+ 5412us) write_op.cc:270] Start()
0807 11:08:57.532122 (+ 159us) write_op.cc:276] Timestamp: P: 1786100923784552 usec, L: 0
0807 11:08:57.541768 (+ 9646us) write_op.cc:270] Start()
0807 11:08:57.541888 (+ 120us) write_op.cc:276] Timestamp: P: 1786100923797129 usec, L: 0
0807 11:08:57.543919 (+ 2031us) write_op.cc:270] Start()
0807 11:08:57.546097 (+ 2178us) write_op.cc:276] Timestamp: P: 1786100923800374 usec, L: 0
0807 11:08:57.546643 (+ 546us) write_op.cc:270] Start()
0807 11:08:57.546725 (+ 82us) write_op.cc:276] Timestamp: P: 1786100923812878 usec, L: 0
0807 11:08:57.547209 (+ 484us) write_op.cc:270] Start()
0807 11:08:57.547288 (+ 79us) write_op.cc:276] Timestamp: P: 1786100923909221 usec, L: 0
0807 11:08:57.547726 (+ 438us) write_op.cc:270] Start()
0807 11:08:57.547799 (+ 73us) write_op.cc:276] Timestamp: P: 1786100923931105 usec, L: 0
0807 11:08:57.554033 (+ 6234us) write_op.cc:270] Start()
0807 11:08:57.554183 (+ 150us) write_op.cc:276] Timestamp: P: 1786100924085097 usec, L: 0
0807 11:08:57.554988 (+ 805us) write_op.cc:270] Start()
0807 11:08:57.555169 (+ 181us) write_op.cc:276] Timestamp: P: 1786100924131857 usec, L: 0
0807 11:08:57.593568 (+ 38399us) write_op.cc:270] Start()
0807 11:08:57.593736 (+ 168us) write_op.cc:276] Timestamp: P: 1786100924147627 usec, L: 0
0807 11:08:57.594720 (+ 984us) write_op.cc:270] Start()
0807 11:08:57.607671 (+ 12951us) write_op.cc:276] Timestamp: P: 1786100924155722 usec, L: 0
0807 11:08:57.608778 (+ 1107us) write_op.cc:270] Start()
0807 11:08:57.608936 (+ 158us) write_op.cc:276] Timestamp: P: 1786100924163913 usec, L: 0
0807 11:08:57.609762 (+ 826us) write_op.cc:270] Start()
0807 11:08:57.609882 (+ 120us) write_op.cc:276] Timestamp: P: 1786100924210490 usec, L: 0
0807 11:08:57.638666 (+ 28784us) write_op.cc:270] Start()
0807 11:08:57.638769 (+ 103us) write_op.cc:276] Timestamp: P: 1786100924214811 usec, L: 0
0807 11:08:57.639560 (+ 791us) write_op.cc:270] Start()
0807 11:08:57.639677 (+ 117us) write_op.cc:276] Timestamp: P: 1786100924303368 usec, L: 0
0807 11:08:57.640334 (+ 657us) write_op.cc:270] Start()
0807 11:08:57.640480 (+ 146us) write_op.cc:276] Timestamp: P: 1786100924460748 usec, L: 0
0807 11:08:57.641097 (+ 617us) write_op.cc:270] Start()
0807 11:08:57.641209 (+ 112us) write_op.cc:276] Timestamp: P: 1786100924504787 usec, L: 0
0807 11:08:57.641711 (+ 502us) write_op.cc:270] Start()
0807 11:08:57.665126 (+ 23415us) write_op.cc:276] Timestamp: P: 1786100924520812 usec, L: 0
0807 11:08:57.686085 (+ 20959us) write_op.cc:270] Start()
0807 11:08:57.686316 (+ 231us) write_op.cc:276] Timestamp: P: 1786100924611022 usec, L: 0
0807 11:08:57.691035 (+ 4719us) write_op.cc:270] Start()
0807 11:08:57.691129 (+ 94us) write_op.cc:276] Timestamp: P: 1786100924671551 usec, L: 0
0807 11:08:57.691637 (+ 508us) write_op.cc:270] Start()
0807 11:08:57.691711 (+ 74us) write_op.cc:276] Timestamp: P: 1786100924677726 usec, L: 0
0807 11:08:57.692139 (+ 428us) write_op.cc:270] Start()
0807 11:08:57.692217 (+ 78us) write_op.cc:276] Timestamp: P: 1786100924726077 usec, L: 0
0807 11:08:57.692655 (+ 438us) write_op.cc:270] Start()
0807 11:08:57.692735 (+ 80us) write_op.cc:276] Timestamp: P: 1786100924788656 usec, L: 0
0807 11:08:57.693141 (+ 406us) write_op.cc:270] Start()
0807 11:08:57.693220 (+ 79us) write_op.cc:276] Timestamp: P: 1786100924797351 usec, L: 0
0807 11:08:57.693658 (+ 438us) write_op.cc:270] Start()
0807 11:08:57.693735 (+ 77us) write_op.cc:276] Timestamp: P: 1786100924813600 usec, L: 0
0807 11:08:57.694191 (+ 456us) write_op.cc:270] Start()
0807 11:08:57.694269 (+ 78us) write_op.cc:276] Timestamp: P: 1786100924888946 usec, L: 0
0807 11:08:57.694729 (+ 460us) write_op.cc:270] Start()
0807 11:08:57.694810 (+ 81us) write_op.cc:276] Timestamp: P: 1786100924941387 usec, L: 0
0807 11:08:57.717294 (+ 22484us) write_op.cc:270] Start()
0807 11:08:57.717396 (+ 102us) write_op.cc:276] Timestamp: P: 1786100924976408 usec, L: 0
0807 11:08:57.717879 (+ 483us) write_op.cc:270] Start()
0807 11:08:57.717956 (+ 77us) write_op.cc:276] Timestamp: P: 1786100925020729 usec, L: 0
0807 11:08:57.718375 (+ 419us) write_op.cc:270] Start()
0807 11:08:57.718456 (+ 81us) write_op.cc:276] Timestamp: P: 1786100925040533 usec, L: 0
0807 11:08:57.718949 (+ 493us) write_op.cc:270] Start()
0807 11:08:57.719026 (+ 77us) write_op.cc:276] Timestamp: P: 1786100925088993 usec, L: 0
0807 11:08:57.719442 (+ 416us) write_op.cc:270] Start()
0807 11:08:57.719518 (+ 76us) write_op.cc:276] Timestamp: P: 1786100925111641 usec, L: 0
0807 11:08:57.719982 (+ 464us) write_op.cc:270] Start()
0807 11:08:57.720064 (+ 82us) write_op.cc:276] Timestamp: P: 1786100925192332 usec, L: 0
0807 11:08:57.720488 (+ 424us) write_op.cc:270] Start()
0807 11:08:57.720565 (+ 77us) write_op.cc:276] Timestamp: P: 1786100925198359 usec, L: 0
0807 11:08:57.721033 (+ 468us) write_op.cc:270] Start()
0807 11:08:57.721190 (+ 157us) write_op.cc:276] Timestamp: P: 1786100925275293 usec, L: 0
0807 11:08:57.721835 (+ 645us) write_op.cc:270] Start()
0807 11:08:57.721995 (+ 160us) write_op.cc:276] Timestamp: P: 1786100925463450 usec, L: 0
0807 11:08:57.722737 (+ 742us) write_op.cc:270] Start()
0807 11:08:57.722816 (+ 79us) write_op.cc:276] Timestamp: P: 1786100925466515 usec, L: 0
0807 11:08:57.742090 (+ 19274us) write_op.cc:270] Start()
0807 11:08:57.742182 (+ 92us) write_op.cc:276] Timestamp: P: 1786100925474983 usec, L: 0
0807 11:08:57.742679 (+ 497us) write_op.cc:270] Start()
0807 11:08:57.742755 (+ 76us) write_op.cc:276] Timestamp: P: 1786100925483997 usec, L: 0
0807 11:08:57.743202 (+ 447us) write_op.cc:270] Start()
0807 11:08:57.743276 (+ 74us) write_op.cc:276] Timestamp: P: 1786100925587513 usec, L: 0
0807 11:08:57.743727 (+ 451us) write_op.cc:270] Start()
0807 11:08:57.743806 (+ 79us) write_op.cc:276] Timestamp: P: 1786100925631988 usec, L: 0
0807 11:08:57.744863 (+ 1057us) write_op.cc:270] Start()
0807 11:08:57.744943 (+ 80us) write_op.cc:276] Timestamp: P: 1786100925688552 usec, L: 0
0807 11:08:57.745468 (+ 525us) write_op.cc:270] Start()
0807 11:08:57.745546 (+ 78us) write_op.cc:276] Timestamp: P: 1786100925702250 usec, L: 0
0807 11:08:57.746537 (+ 991us) write_op.cc:270] Start()
0807 11:08:57.746618 (+ 81us) write_op.cc:276] Timestamp: P: 1786100925836184 usec, L: 0
0807 11:08:57.747099 (+ 481us) write_op.cc:270] Start()
0807 11:08:57.747184 (+ 85us) write_op.cc:276] Timestamp: P: 1786100925951899 usec, L: 0
0807 11:08:57.747640 (+ 456us) write_op.cc:270] Start()
0807 11:08:57.751834 (+ 4194us) write_op.cc:276] Timestamp: P: 1786100925998202 usec, L: 0
0807 11:08:57.752362 (+ 528us) write_op.cc:270] Start()
0807 11:08:57.752521 (+ 159us) write_op.cc:276] Timestamp: P: 1786100926380698 usec, L: 0
0807 11:08:57.753185 (+ 664us) write_op.cc:270] Start()
0807 11:08:57.753276 (+ 91us) write_op.cc:276] Timestamp: P: 1786100926389047 usec, L: 0
0807 11:08:57.753788 (+ 512us) write_op.cc:270] Start()
0807 11:08:57.753867 (+ 79us) write_op.cc:276] Timestamp: P: 1786100926479157 usec, L: 0
0807 11:08:57.754301 (+ 434us) write_op.cc:270] Start()
0807 11:08:57.754386 (+ 85us) write_op.cc:276] Timestamp: P: 1786100926547762 usec, L: 0
0807 11:08:57.754813 (+ 427us) write_op.cc:270] Start()
0807 11:08:57.754924 (+ 111us) write_op.cc:276] Timestamp: P: 1786100926632847 usec, L: 0
0807 11:08:57.756812 (+ 1888us) write_op.cc:270] Start()
0807 11:08:57.756891 (+ 79us) write_op.cc:276] Timestamp: P: 1786100926650104 usec, L: 0
0807 11:08:57.757334 (+ 443us) write_op.cc:270] Start()
0807 11:08:57.757418 (+ 84us) write_op.cc:276] Timestamp: P: 1786100926675632 usec, L: 0
0807 11:08:57.757823 (+ 405us) write_op.cc:270] Start()
0807 11:08:57.757896 (+ 73us) write_op.cc:276] Timestamp: P: 1786100926753951 usec, L: 0
0807 11:08:57.760658 (+ 2762us) write_op.cc:270] Start()
0807 11:08:57.760740 (+ 82us) write_op.cc:276] Timestamp: P: 1786100926764086 usec, L: 0
0807 11:08:57.762043 (+ 1303us) write_op.cc:270] Start()
0807 11:08:57.762128 (+ 85us) write_op.cc:276] Timestamp: P: 1786100926827546 usec, L: 0
0807 11:08:57.762601 (+ 473us) write_op.cc:270] Start()
0807 11:08:57.762685 (+ 84us) write_op.cc:276] Timestamp: P: 1786100926838631 usec, L: 0
0807 11:08:57.763448 (+ 763us) write_op.cc:270] Start()
0807 11:08:57.763530 (+ 82us) write_op.cc:276] Timestamp: P: 1786100926847834 usec, L: 0
0807 11:08:57.763972 (+ 442us) write_op.cc:270] Start()
0807 11:08:57.764048 (+ 76us) write_op.cc:276] Timestamp: P: 1786100926979771 usec, L: 0
0807 11:08:57.764468 (+ 420us) write_op.cc:270] Start()
0807 11:08:57.764542 (+ 74us) write_op.cc:276] Timestamp: P: 1786100926981671 usec, L: 0
0807 11:08:57.765006 (+ 464us) write_op.cc:270] Start()
0807 11:08:57.765088 (+ 82us) write_op.cc:276] Timestamp: P: 1786100926989758 usec, L: 0
0807 11:08:57.765587 (+ 499us) write_op.cc:270] Start()
0807 11:08:57.765660 (+ 73us) write_op.cc:276] Timestamp: P: 1786100927062438 usec, L: 0
0807 11:08:57.766118 (+ 458us) write_op.cc:270] Start()
0807 11:08:57.766201 (+ 83us) write_op.cc:276] Timestamp: P: 1786100927105963 usec, L: 0
0807 11:08:57.766832 (+ 631us) write_op.cc:270] Start()
0807 11:08:57.766931 (+ 99us) write_op.cc:276] Timestamp: P: 1786100927167630 usec, L: 0
0807 11:08:57.767685 (+ 754us) write_op.cc:270] Start()
0807 11:08:57.767781 (+ 96us) write_op.cc:276] Timestamp: P: 1786100927188582 usec, L: 0
0807 11:08:57.768443 (+ 662us) write_op.cc:270] Start()
0807 11:08:57.768533 (+ 90us) write_op.cc:276] Timestamp: P: 1786100927200721 usec, L: 0
0807 11:08:57.769178 (+ 645us) write_op.cc:270] Start()
0807 11:08:57.769256 (+ 78us) write_op.cc:276] Timestamp: P: 1786100927202870 usec, L: 0
0807 11:08:57.769746 (+ 490us) write_op.cc:270] Start()
0807 11:08:57.769842 (+ 96us) write_op.cc:276] Timestamp: P: 1786100927228012 usec, L: 0
0807 11:08:57.770426 (+ 584us) write_op.cc:270] Start()
0807 11:08:57.770517 (+ 91us) write_op.cc:276] Timestamp: P: 1786100927262187 usec, L: 0
0807 11:08:57.771105 (+ 588us) write_op.cc:270] Start()
0807 11:08:57.771196 (+ 91us) write_op.cc:276] Timestamp: P: 1786100927271690 usec, L: 0
0807 11:08:57.771801 (+ 605us) write_op.cc:270] Start()
0807 11:08:57.771895 (+ 94us) write_op.cc:276] Timestamp: P: 1786100927278073 usec, L: 0
0807 11:08:57.772522 (+ 627us) write_op.cc:270] Start()
0807 11:08:57.772606 (+ 84us) write_op.cc:276] Timestamp: P: 1786100927324780 usec, L: 0
0807 11:08:57.773083 (+ 477us) write_op.cc:270] Start()
0807 11:08:57.773176 (+ 93us) write_op.cc:276] Timestamp: P: 1786100927591466 usec, L: 0
0807 11:08:57.773663 (+ 487us) write_op.cc:270] Start()
0807 11:08:57.773743 (+ 80us) write_op.cc:276] Timestamp: P: 1786100927608761 usec, L: 0
0807 11:08:57.774318 (+ 575us) write_op.cc:270] Start()
0807 11:08:57.774465 (+ 147us) write_op.cc:276] Timestamp: P: 1786100927634213 usec, L: 0
0807 11:08:57.774988 (+ 523us) write_op.cc:270] Start()
0807 11:08:57.775080 (+ 92us) write_op.cc:276] Timestamp: P: 1786100927641929 usec, L: 0
0807 11:08:57.775580 (+ 500us) write_op.cc:270] Start()
0807 11:08:57.775658 (+ 78us) write_op.cc:276] Timestamp: P: 1786100927650409 usec, L: 0
0807 11:08:57.776112 (+ 454us) write_op.cc:270] Start()
0807 11:08:57.776197 (+ 85us) write_op.cc:276] Timestamp: P: 1786100927701254 usec, L: 0
0807 11:08:57.776685 (+ 488us) write_op.cc:270] Start()
0807 11:08:57.776766 (+ 81us) write_op.cc:276] Timestamp: P: 1786100927727753 usec, L: 0
0807 11:08:57.777358 (+ 592us) write_op.cc:270] Start()
0807 11:08:57.777445 (+ 87us) write_op.cc:276] Timestamp: P: 1786100927736773 usec, L: 0
0807 11:08:57.778070 (+ 625us) write_op.cc:270] Start()
0807 11:08:57.778153 (+ 83us) write_op.cc:276] Timestamp: P: 1786100927739990 usec, L: 0
0807 11:08:57.778679 (+ 526us) write_op.cc:270] Start()
0807 11:08:57.778763 (+ 84us) write_op.cc:276] Timestamp: P: 1786100927834832 usec, L: 0
0807 11:08:57.779469 (+ 706us) write_op.cc:270] Start()
0807 11:08:57.779562 (+ 93us) write_op.cc:276] Timestamp: P: 1786100927846735 usec, L: 0
0807 11:08:57.780038 (+ 476us) write_op.cc:270] Start()
0807 11:08:57.780116 (+ 78us) write_op.cc:276] Timestamp: P: 1786100927968464 usec, L: 0
0807 11:08:57.780590 (+ 474us) write_op.cc:270] Start()
0807 11:08:57.780801 (+ 211us) write_op.cc:276] Timestamp: P: 1786100927974933 usec, L: 0
0807 11:08:57.781475 (+ 674us) write_op.cc:270] Start()
0807 11:08:57.781558 (+ 83us) write_op.cc:276] Timestamp: P: 1786100927985827 usec, L: 0
0807 11:08:57.782008 (+ 450us) write_op.cc:270] Start()
0807 11:08:57.782091 (+ 83us) write_op.cc:276] Timestamp: P: 1786100928016513 usec, L: 0
0807 11:08:57.782578 (+ 487us) write_op.cc:270] Start()
0807 11:08:57.782660 (+ 82us) write_op.cc:276] Timestamp: P: 1786100928023085 usec, L: 0
0807 11:08:57.790904 (+ 8244us) write_op.cc:270] Start()
0807 11:08:57.791004 (+ 100us) write_op.cc:276] Timestamp: P: 1786100928027572 usec, L: 0
0807 11:08:57.795844 (+ 4840us) write_op.cc:270] Start()
0807 11:08:57.795945 (+ 101us) write_op.cc:276] Timestamp: P: 1786100928071181 usec, L: 0
0807 11:08:57.797623 (+ 1678us) write_op.cc:270] Start()
0807 11:08:57.797709 (+ 86us) write_op.cc:276] Timestamp: P: 1786100928080946 usec, L: 0
0807 11:08:57.799591 (+ 1882us) write_op.cc:270] Start()
0807 11:08:57.799686 (+ 95us) write_op.cc:276] Timestamp: P: 1786100928142288 usec, L: 0
0807 11:08:57.800761 (+ 1075us) write_op.cc:270] Start()
0807 11:08:57.800866 (+ 105us) write_op.cc:276] Timestamp: P: 1786100928323971 usec, L: 0
0807 11:08:57.802103 (+ 1237us) write_op.cc:270] Start()
0807 11:08:57.802187 (+ 84us) write_op.cc:276] Timestamp: P: 1786100928346939 usec, L: 0
0807 11:08:57.805851 (+ 3664us) write_op.cc:270] Start()
0807 11:08:57.805948 (+ 97us) write_op.cc:276] Timestamp: P: 1786100928366505 usec, L: 0
0807 11:08:57.806444 (+ 496us) write_op.cc:270] Start()
0807 11:08:57.806536 (+ 92us) write_op.cc:276] Timestamp: P: 1786100928411893 usec, L: 0
0807 11:08:57.807019 (+ 483us) write_op.cc:270] Start()
0807 11:08:57.807102 (+ 83us) write_op.cc:276] Timestamp: P: 1786100928413891 usec, L: 0
0807 11:08:57.807572 (+ 470us) write_op.cc:270] Start()
0807 11:08:57.807651 (+ 79us) write_op.cc:276] Timestamp: P: 1786100928591185 usec, L: 0
0807 11:08:57.810448 (+ 2797us) write_op.cc:270] Start()
0807 11:08:57.810542 (+ 94us) write_op.cc:276] Timestamp: P: 1786100928677802 usec, L: 0
0807 11:08:57.811046 (+ 504us) write_op.cc:270] Start()
0807 11:08:57.812129 (+ 1083us) write_op.cc:276] Timestamp: P: 1786100928847572 usec, L: 0
0807 11:08:57.812652 (+ 523us) write_op.cc:270] Start()
0807 11:08:57.812736 (+ 84us) write_op.cc:276] Timestamp: P: 1786100928874084 usec, L: 0
0807 11:08:57.813206 (+ 470us) write_op.cc:270] Start()
0807 11:08:57.813285 (+ 79us) write_op.cc:276] Timestamp: P: 1786100928971065 usec, L: 0
0807 11:08:57.813769 (+ 484us) write_op.cc:270] Start()
0807 11:08:57.813855 (+ 86us) write_op.cc:276] Timestamp: P: 1786100929078335 usec, L: 0
0807 11:08:57.814354 (+ 499us) write_op.cc:270] Start()
0807 11:08:57.814437 (+ 83us) write_op.cc:276] Timestamp: P: 1786100929198301 usec, L: 0
0807 11:08:57.814960 (+ 523us) write_op.cc:270] Start()
0807 11:08:57.815060 (+ 100us) write_op.cc:276] Timestamp: P: 1786100929205062 usec, L: 0
0807 11:08:57.815604 (+ 544us) write_op.cc:270] Start()
0807 11:08:57.815693 (+ 89us) write_op.cc:276] Timestamp: P: 1786100929238337 usec, L: 0
0807 11:08:57.816154 (+ 461us) write_op.cc:270] Start()
0807 11:08:57.816245 (+ 91us) write_op.cc:276] Timestamp: P: 1786100929285004 usec, L: 0
0807 11:08:57.816726 (+ 481us) write_op.cc:270] Start()
0807 11:08:57.816811 (+ 85us) write_op.cc:276] Timestamp: P: 1786100929421850 usec, L: 0
0807 11:08:57.817279 (+ 468us) write_op.cc:270] Start()
0807 11:08:57.817367 (+ 88us) write_op.cc:276] Timestamp: P: 1786100929430555 usec, L: 0
0807 11:08:57.817799 (+ 432us) write_op.cc:270] Start()
0807 11:08:57.817881 (+ 82us) write_op.cc:276] Timestamp: P: 1786100929567486 usec, L: 0
0807 11:08:57.818357 (+ 476us) write_op.cc:270] Start()
0807 11:08:57.818431 (+ 74us) write_op.cc:276] Timestamp: P: 1786100929643681 usec, L: 0
0807 11:08:57.829618 (+ 11187us) write_op.cc:270] Start()
0807 11:08:57.829727 (+ 109us) write_op.cc:276] Timestamp: P: 1786100929652162 usec, L: 0
0807 11:08:57.830378 (+ 651us) write_op.cc:270] Start()
0807 11:08:57.830476 (+ 98us) write_op.cc:276] Timestamp: P: 1786100929719957 usec, L: 0
0807 11:08:57.841934 (+ 11458us) write_op.cc:270] Start()
0807 11:08:57.842028 (+ 94us) write_op.cc:276] Timestamp: P: 1786100929723104 usec, L: 0
0807 11:08:57.846464 (+ 4436us) write_op.cc:270] Start()
0807 11:08:57.846560 (+ 96us) write_op.cc:276] Timestamp: P: 1786100929770918 usec, L: 0
0807 11:08:57.848484 (+ 1924us) write_op.cc:270] Start()
0807 11:08:57.848574 (+ 90us) write_op.cc:276] Timestamp: P: 1786100929807944 usec, L: 0
0807 11:08:57.850198 (+ 1624us) write_op.cc:270] Start()
0807 11:08:57.850307 (+ 109us) write_op.cc:276] Timestamp: P: 1786100929861883 usec, L: 0
0807 11:08:57.853625 (+ 3318us) write_op.cc:270] Start()
0807 11:08:57.854369 (+ 744us) write_op.cc:276] Timestamp: P: 1786100929915238 usec, L: 0
0807 11:08:57.855530 (+ 1161us) write_op.cc:270] Start()
0807 11:08:57.855626 (+ 96us) write_op.cc:276] Timestamp: P: 1786100929982188 usec, L: 0
0807 11:08:57.857255 (+ 1629us) write_op.cc:270] Start()
0807 11:08:57.857364 (+ 109us) write_op.cc:276] Timestamp: P: 1786100930020254 usec, L: 0
0807 11:08:57.857908 (+ 544us) write_op.cc:270] Start()
0807 11:08:57.857998 (+ 90us) write_op.cc:276] Timestamp: P: 1786100930034889 usec, L: 0
0807 11:08:57.858464 (+ 466us) write_op.cc:270] Start()
0807 11:08:57.858543 (+ 79us) write_op.cc:276] Timestamp: P: 1786100930051260 usec, L: 0
0807 11:08:57.887361 (+ 28818us) write_op.cc:270] Start()
0807 11:08:57.887484 (+ 123us) write_op.cc:276] Timestamp: P: 1786100930145140 usec, L: 0
0807 11:08:57.888004 (+ 520us) write_op.cc:270] Start()
0807 11:08:57.888077 (+ 73us) write_op.cc:276] Timestamp: P: 1786100930178841 usec, L: 0
0807 11:08:57.888576 (+ 499us) write_op.cc:270] Start()
0807 11:08:57.888659 (+ 83us) write_op.cc:276] Timestamp: P: 1786100930180884 usec, L: 0
0807 11:08:57.889085 (+ 426us) write_op.cc:270] Start()
0807 11:08:57.889156 (+ 71us) write_op.cc:276] Timestamp: P: 1786100930184572 usec, L: 0
0807 11:08:57.889568 (+ 412us) write_op.cc:270] Start()
0807 11:08:57.889638 (+ 70us) write_op.cc:276] Timestamp: P: 1786100930191749 usec, L: 0
0807 11:08:57.890045 (+ 407us) write_op.cc:270] Start()
0807 11:08:57.890136 (+ 91us) write_op.cc:276] Timestamp: P: 1786100930353483 usec, L: 0
0807 11:08:57.890738 (+ 602us) write_op.cc:270] Start()
0807 11:08:57.890806 (+ 68us) write_op.cc:276] Timestamp: P: 1786100930355588 usec, L: 0
0807 11:08:57.891243 (+ 437us) write_op.cc:270] Start()
0807 11:08:57.891325 (+ 82us) write_op.cc:276] Timestamp: P: 1786100930853907 usec, L: 0
0807 11:08:57.896366 (+ 5041us) write_op.cc:270] Start()
0807 11:08:57.896440 (+ 74us) write_op.cc:276] Timestamp: P: 1786100930861128 usec, L: 0
0807 11:08:57.896871 (+ 431us) write_op.cc:270] Start()
0807 11:08:57.896944 (+ 73us) write_op.cc:276] Timestamp: P: 1786100931203020 usec, L: 0
0807 11:08:57.897408 (+ 464us) write_op.cc:270] Start()
0807 11:08:57.897485 (+ 77us) write_op.cc:276] Timestamp: P: 1786100931236278 usec, L: 0
0807 11:08:57.897881 (+ 396us) write_op.cc:270] Start()
0807 11:08:57.897948 (+ 67us) write_op.cc:276] Timestamp: P: 1786100931295782 usec, L: 0
0807 11:08:57.898351 (+ 403us) write_op.cc:270] Start()
0807 11:08:57.898418 (+ 67us) write_op.cc:276] Timestamp: P: 1786100931440572 usec, L: 0
0807 11:08:57.898826 (+ 408us) write_op.cc:270] Start()
0807 11:08:57.898918 (+ 92us) write_op.cc:276] Timestamp: P: 1786100931483649 usec, L: 0
0807 11:08:57.899344 (+ 426us) write_op.cc:270] Start()
0807 11:08:57.899414 (+ 70us) write_op.cc:276] Timestamp: P: 1786100931504694 usec, L: 0
0807 11:08:57.899961 (+ 547us) write_op.cc:270] Start()
0807 11:08:57.900115 (+ 154us) write_op.cc:276] Timestamp: P: 1786100931535589 usec, L: 0
0807 11:08:57.900556 (+ 441us) write_op.cc:270] Start()
0807 11:08:57.901322 (+ 766us) write_op.cc:276] Timestamp: P: 1786100931611895 usec, L: 0
0807 11:08:57.901754 (+ 432us) write_op.cc:270] Start()
0807 11:08:57.901830 (+ 76us) write_op.cc:276] Timestamp: P: 1786100931698268 usec, L: 0
0807 11:08:57.903453 (+ 1623us) write_op.cc:270] Start()
0807 11:08:57.903527 (+ 74us) write_op.cc:276] Timestamp: P: 1786100931721301 usec, L: 0
0807 11:08:57.903932 (+ 405us) write_op.cc:270] Start()
0807 11:08:57.904001 (+ 69us) write_op.cc:276] Timestamp: P: 1786100931731410 usec, L: 0
0807 11:08:57.904417 (+ 416us) write_op.cc:270] Start()
0807 11:08:57.904493 (+ 76us) write_op.cc:276] Timestamp: P: 1786100931825296 usec, L: 0
0807 11:08:57.904882 (+ 389us) write_op.cc:270] Start()
0807 11:08:57.909083 (+ 4201us) write_op.cc:276] Timestamp: P: 1786100931869934 usec, L: 0
0807 11:08:57.909561 (+ 478us) write_op.cc:270] Start()
0807 11:08:57.909633 (+ 72us) write_op.cc:276] Timestamp: P: 1786100931884581 usec, L: 0
0807 11:08:57.910101 (+ 468us) write_op.cc:270] Start()
0807 11:08:57.910171 (+ 70us) write_op.cc:276] Timestamp: P: 1786100931996210 usec, L: 0
0807 11:08:57.920560 (+ 10389us) write_op.cc:270] Start()
0807 11:08:57.921190 (+ 630us) write_op.cc:276] Timestamp: P: 1786100932059543 usec, L: 0
0807 11:08:57.921799 (+ 609us) write_op.cc:270] Start()
0807 11:08:57.921874 (+ 75us) write_op.cc:276] Timestamp: P: 1786100932073777 usec, L: 0
0807 11:08:57.922341 (+ 467us) write_op.cc:270] Start()
0807 11:08:57.922430 (+ 89us) write_op.cc:276] Timestamp: P: 1786100932098521 usec, L: 0
0807 11:08:57.922916 (+ 486us) write_op.cc:270] Start()
0807 11:08:57.922988 (+ 72us) write_op.cc:276] Timestamp: P: 1786100932135152 usec, L: 0
0807 11:08:57.923423 (+ 435us) write_op.cc:270] Start()
0807 11:08:57.923490 (+ 67us) write_op.cc:276] Timestamp: P: 1786100932226348 usec, L: 0
0807 11:08:57.927538 (+ 4048us) write_op.cc:270] Start()
0807 11:08:57.927612 (+ 74us) write_op.cc:276] Timestamp: P: 1786100932236251 usec, L: 0
0807 11:08:57.928043 (+ 431us) write_op.cc:270] Start()
0807 11:08:57.928115 (+ 72us) write_op.cc:276] Timestamp: P: 1786100932264781 usec, L: 0
0807 11:08:57.928633 (+ 518us) write_op.cc:270] Start()
0807 11:08:57.928703 (+ 70us) write_op.cc:276] Timestamp: P: 1786100932301751 usec, L: 0
0807 11:08:57.929126 (+ 423us) write_op.cc:270] Start()
0807 11:08:57.929201 (+ 75us) write_op.cc:276] Timestamp: P: 1786100932329856 usec, L: 0
0807 11:08:57.929614 (+ 413us) write_op.cc:270] Start()
0807 11:08:57.929688 (+ 74us) write_op.cc:276] Timestamp: P: 1786100932340002 usec, L: 0
0807 11:08:57.930115 (+ 427us) write_op.cc:270] Start()
0807 11:08:57.930184 (+ 69us) write_op.cc:276] Timestamp: P: 1786100932454250 usec, L: 0
0807 11:08:57.930624 (+ 440us) write_op.cc:270] Start()
0807 11:08:57.930697 (+ 73us) write_op.cc:276] Timestamp: P: 1786100932460321 usec, L: 0
0807 11:08:57.945870 (+ 15173us) write_op.cc:270] Start()
0807 11:08:57.946447 (+ 577us) write_op.cc:276] Timestamp: P: 1786100932490083 usec, L: 0
0807 11:08:57.946979 (+ 532us) write_op.cc:270] Start()
0807 11:08:57.947053 (+ 74us) write_op.cc:276] Timestamp: P: 1786100932597102 usec, L: 0
0807 11:08:57.947500 (+ 447us) write_op.cc:270] Start()
0807 11:08:57.947571 (+ 71us) write_op.cc:276] Timestamp: P: 1786100932601609 usec, L: 0
0807 11:08:57.947982 (+ 411us) write_op.cc:270] Start()
0807 11:08:57.948052 (+ 70us) write_op.cc:276] Timestamp: P: 1786100932625633 usec, L: 0
0807 11:08:57.948452 (+ 400us) write_op.cc:270] Start()
0807 11:08:57.948544 (+ 92us) write_op.cc:276] Timestamp: P: 1786100932636973 usec, L: 0
0807 11:08:57.948946 (+ 402us) write_op.cc:270] Start()
0807 11:08:57.949016 (+ 70us) write_op.cc:276] Timestamp: P: 1786100932702862 usec, L: 0
0807 11:08:57.949427 (+ 411us) write_op.cc:270] Start()
0807 11:08:57.949494 (+ 67us) write_op.cc:276] Timestamp: P: 1786100932789552 usec, L: 0
0807 11:08:57.949927 (+ 433us) write_op.cc:270] Start()
0807 11:08:57.950002 (+ 75us) write_op.cc:276] Timestamp: P: 1786100932795190 usec, L: 0
0807 11:08:57.950499 (+ 497us) write_op.cc:270] Start()
0807 11:08:57.950568 (+ 69us) write_op.cc:276] Timestamp: P: 1786100932797068 usec, L: 0
0807 11:08:57.965977 (+ 15409us) write_op.cc:270] Start()
0807 11:08:57.966072 (+ 95us) write_op.cc:276] Timestamp: P: 1786100932807635 usec, L: 0
0807 11:08:57.966625 (+ 553us) write_op.cc:270] Start()
0807 11:08:57.966703 (+ 78us) write_op.cc:276] Timestamp: P: 1786100932809201 usec, L: 0
0807 11:08:57.967205 (+ 502us) write_op.cc:270] Start()
0807 11:08:57.967275 (+ 70us) write_op.cc:276] Timestamp: P: 1786100932855394 usec, L: 0
0807 11:08:57.967726 (+ 451us) write_op.cc:270] Start()
0807 11:08:57.967794 (+ 68us) write_op.cc:276] Timestamp: P: 1786100932981475 usec, L: 0
0807 11:08:57.968196 (+ 402us) write_op.cc:270] Start()
0807 11:08:57.968275 (+ 79us) write_op.cc:276] Timestamp: P: 1786100932995240 usec, L: 0
0807 11:08:57.968684 (+ 409us) write_op.cc:270] Start()
0807 11:08:57.968753 (+ 69us) write_op.cc:276] Timestamp: P: 1786100933010111 usec, L: 0
0807 11:08:57.969183 (+ 430us) write_op.cc:270] Start()
0807 11:08:57.969250 (+ 67us) write_op.cc:276] Timestamp: P: 1786100933015549 usec, L: 0
0807 11:08:57.969683 (+ 433us) write_op.cc:270] Start()
0807 11:08:57.969749 (+ 66us) write_op.cc:276] Timestamp: P: 1786100933173255 usec, L: 0
0807 11:08:57.970239 (+ 490us) write_op.cc:270] Start()
0807 11:08:57.970324 (+ 85us) write_op.cc:276] Timestamp: P: 1786100933204771 usec, L: 0
0807 11:08:57.970784 (+ 460us) write_op.cc:270] Start()
0807 11:08:57.970882 (+ 98us) write_op.cc:276] Timestamp: P: 1786100933219674 usec, L: 0
0807 11:08:57.971377 (+ 495us) write_op.cc:270] Start()
0807 11:08:57.971450 (+ 73us) write_op.cc:276] Timestamp: P: 1786100933287713 usec, L: 0
0807 11:08:57.971856 (+ 406us) write_op.cc:270] Start()
0807 11:08:57.971926 (+ 70us) write_op.cc:276] Timestamp: P: 1786100933471116 usec, L: 0
0807 11:08:57.972334 (+ 408us) write_op.cc:270] Start()
0807 11:08:57.972406 (+ 72us) write_op.cc:276] Timestamp: P: 1786100933555479 usec, L: 0
0807 11:08:57.972859 (+ 453us) write_op.cc:270] Start()
0807 11:08:57.972930 (+ 71us) write_op.cc:276] Timestamp: P: 1786100933557967 usec, L: 0
0807 11:08:57.973333 (+ 403us) write_op.cc:270] Start()
0807 11:08:57.973402 (+ 69us) write_op.cc:276] Timestamp: P: 1786100933655552 usec, L: 0
0807 11:08:58.063399 (+ 89997us) log.cc:842] Serialized 116089 byte log entry
0807 11:08:58.087820 (+ 24421us) raft_consensus.cc:1631] Marking committed up to 206
0807 11:08:58.088136 (+ 316us) log.cc:842] Serialized 14 byte log entry
0807 11:08:58.340329 (+252193us) raft_con
I20260807 11:08:59.139946 24846 raft_consensus.cc:482] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.140419 24846 raft_consensus.cc:504] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.140810 24261 tablet_bootstrap.cc:492] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:59.141214 24261 ts_tablet_manager.cc:1397] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.108s user 0.025s sys 0.036s
I20260807 11:08:59.142340 24846 leader_election.cc:288] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.143327 24261 raft_consensus.cc:348] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.143800 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:59.144120 24261 raft_consensus.cc:374] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.144352 24261 raft_consensus.cc:729] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.144237 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde5287f17a944708d7678c57bf37bf9" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:59.144954 24261 consensus_queue.cc:260] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.146297 23954 leader_election.cc:302] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.146822 24261 ts_tablet_manager.cc:1428] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 11:08:59.148794 24846 raft_consensus.cc:2726] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:59.150364 24261 tablet_bootstrap.cc:492] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:59.159310 24846 raft_consensus.cc:482] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.159803 24846 raft_consensus.cc:504] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:59.164803 23954 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 5eaf45dad4a944dab77330db6fc53222
I20260807 11:08:59.165946 24846 leader_election.cc:288] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:59.172886 23951 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5eaf45dad4a944dab77330db6fc53222
I20260807 11:08:59.173267 23951 leader_election.cc:302] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.177512 24846 raft_consensus.cc:2726] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:59.194224 24844 consensus_queue.cc:1035] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:59.198138 24846 raft_consensus.cc:482] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.198575 24846 raft_consensus.cc:504] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.203424 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c78502f0a5485c9ffe4434c14567e0" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:59.204154 23614 raft_consensus.cc:2454] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
I20260807 11:08:59.201993 24846 leader_election.cc:288] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:08:59.205119 23951 leader_election.cc:341] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 84c78502f0a5485c9ffe4434c14567e0
I20260807 11:08:59.206283 23954 leader_election.cc:302] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.216902 24846 raft_consensus.cc:2781] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:59.217499 24846 raft_consensus.cc:482] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:59.217854 24846 raft_consensus.cc:3037] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:59.220685 23510 consensus_peers.cc:487] T b0ee41a2c21548e7961b3884e8c7a4ff P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:59.224534 24261 tablet_bootstrap.cc:654] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.232923 24846 raft_consensus.cc:504] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.241782 24266 tablet_bootstrap.cc:492] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:59.245043 24266 ts_tablet_manager.cc:1397] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.244s user 0.019s sys 0.027s
I20260807 11:08:59.247195 24262 tablet_bootstrap.cc:492] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:59.247596 24262 ts_tablet_manager.cc:1397] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.230s user 0.009s sys 0.002s
I20260807 11:08:59.250324 24266 raft_consensus.cc:348] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.254051 24266 raft_consensus.cc:374] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.255077 24266 raft_consensus.cc:729] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.256197 24266 consensus_queue.cc:260] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.273844 24982 consensus_queue.cc:1035] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:59.276081 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c78502f0a5485c9ffe4434c14567e0" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:59.276794 23614 raft_consensus.cc:3037] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.283883 24262 raft_consensus.cc:348] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.284570 24262 raft_consensus.cc:374] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.284804 24262 raft_consensus.cc:729] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.285671 24262 consensus_queue.cc:260] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.288197 24262 ts_tablet_manager.cc:1428] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.040s user 0.005s sys 0.001s
I20260807 11:08:59.289048 24262 tablet_bootstrap.cc:492] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:59.295557 24846 leader_election.cc:288] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.294658 23614 raft_consensus.cc:2454] T 84c78502f0a5485c9ffe4434c14567e0 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:08:59.301345 24261 tablet_bootstrap.cc:492] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:59.301781 24261 ts_tablet_manager.cc:1397] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.152s user 0.007s sys 0.008s
W20260807 11:08:59.302145 23951 leader_election.cc:341] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 84c78502f0a5485c9ffe4434c14567e0
I20260807 11:08:59.303747 25089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:08:59.304764 25089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:08:59.311662 25089 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:08:59.312795 24681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:08:59.315519 24261 raft_consensus.cc:348] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.316396 24261 raft_consensus.cc:374] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.316650 24261 raft_consensus.cc:729] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.317255 24261 consensus_queue.cc:260] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:08:59.336010 23507 consensus_peers.cc:487] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10f6d2989e09466aaa374575a11f40e3. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:59.336997 24844 raft_consensus.cc:482] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.337450 24844 raft_consensus.cc:504] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.339363 24844 leader_election.cc:288] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.344098 24846 raft_consensus.cc:482] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.359763 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:59.360788 24846 raft_consensus.cc:504] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:59.362181 23510 leader_election.cc:341] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.362829 24846 leader_election.cc:288] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.356611 23954 leader_election.cc:302] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.364634 24846 raft_consensus.cc:2781] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:59.365058 24846 raft_consensus.cc:686] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
I20260807 11:08:59.365159 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:59.369186 24261 ts_tablet_manager.cc:1428] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.067s user 0.006s sys 0.000s
I20260807 11:08:59.365842 24846 consensus_queue.cc:237] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.377199 24261 tablet_bootstrap.cc:492] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:59.382164 24261 tablet_bootstrap.cc:654] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.402036 25028 raft_consensus.cc:482] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.403699 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "275ff54bfeae4fd3ad19e697a2b83e74" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:59.404498 23841 raft_consensus.cc:2379] T 275ff54bfeae4fd3ad19e697a2b83e74 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:08:59.403945 25028 raft_consensus.cc:504] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.405725 23951 leader_election.cc:302] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.405045 25092 raft_consensus.cc:482] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.406417 25028 leader_election.cc:288] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.406574 24846 raft_consensus.cc:3037] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.403453 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:59.408605 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:59.409031 23844 raft_consensus.cc:2454] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
W20260807 11:08:59.410272 23745 leader_election.cc:341] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.411613 23507 leader_election.cc:302] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:59.412611 24982 raft_consensus.cc:2781] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:59.412926 24982 raft_consensus.cc:482] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:59.412954 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:59.413247 24982 raft_consensus.cc:3037] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:59.414036 23745 leader_election.cc:341] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.414362 23745 leader_election.cc:302] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:59.415254 25028 raft_consensus.cc:2726] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:59.413609 25092 raft_consensus.cc:504] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.424817 24262 tablet_bootstrap.cc:654] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.429868 24982 raft_consensus.cc:504] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:59.448671 23951 leader_election.cc:341] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 64cb221021564d66bfecf5cd91bcec5c
I20260807 11:08:59.445063 25092 leader_election.cc:288] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.456425 24266 ts_tablet_manager.cc:1428] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.211s user 0.008s sys 0.005s
I20260807 11:08:59.437994 24844 consensus_queue.cc:1035] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:08:59.440308 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cb221021564d66bfecf5cd91bcec5c" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:59.472361 23614 raft_consensus.cc:2454] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
I20260807 11:08:59.473678 23954 leader_election.cc:302] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.475221 25092 raft_consensus.cc:2781] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:59.476302 25092 raft_consensus.cc:482] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:59.477020 25092 raft_consensus.cc:3037] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.478291 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:59.479228 23841 raft_consensus.cc:3037] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.479737 24846 raft_consensus.cc:2726] T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:59.496984 24266 tablet_bootstrap.cc:492] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:59.503109 24261 tablet_bootstrap.cc:492] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:59.503599 24261 ts_tablet_manager.cc:1397] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.127s user 0.008s sys 0.003s
I20260807 11:08:59.514398 24261 raft_consensus.cc:348] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.515102 24261 raft_consensus.cc:374] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.515347 24261 raft_consensus.cc:729] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.515887 24261 consensus_queue.cc:260] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:08:59.518425 23510 consensus_peers.cc:487] T 1ce42b3bd73242418f510c5b83259238 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:08:59.526146 24261 ts_tablet_manager.cc:1428] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260807 11:08:59.536994 25092 raft_consensus.cc:504] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.539917 25092 leader_election.cc:288] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.540917 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cb221021564d66bfecf5cd91bcec5c" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:08:59.541514 23614 raft_consensus.cc:3037] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.546095 24266 tablet_bootstrap.cc:654] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.546208 24261 tablet_bootstrap.cc:492] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:08:59.552449 23951 leader_election.cc:341] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 64cb221021564d66bfecf5cd91bcec5c
I20260807 11:08:59.562153 23614 raft_consensus.cc:2454] T 64cb221021564d66bfecf5cd91bcec5c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:08:59.563781 23954 leader_election.cc:302] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.564868 24846 raft_consensus.cc:482] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.565498 24846 raft_consensus.cc:504] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.566398 24261 tablet_bootstrap.cc:654] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.568066 24846 leader_election.cc:288] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.568658 24846 raft_consensus.cc:2781] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:59.569129 24846 raft_consensus.cc:686] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
W20260807 11:08:59.570889 23951 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 8a2df15b35bd435baaf95a708ec85a37
I20260807 11:08:59.570379 24846 consensus_queue.cc:237] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.579545 25028 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.580145 25028 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.580473 24675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59452 (request call id 4) took 1084 ms. Trace:
I20260807 11:08:59.584673 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:59.585903 24643 ts_manager.cc:194] Registered new tserver with Master: c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.587118 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:08:59.587381 24875 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 11:08:59.588773 24643 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.22.115.195:55411 (request call id 13) took 969 ms (client timeout 1000 ms). Trace:
W20260807 11:08:59.589238 24643 rpcz_store.cc:269] 0807 11:08:58.619240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:58.619402 (+ 162us) service_pool.cc:227] Handling call
0807 11:08:59.585192 (+965790us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400030554. stack: 00007f359eee2033 00007f359eee1f30 00007f359ea63534 00000000004db2b4 00000000004db249 00007f35a5deeaf0 00007f35a5e71f2a 00007f35a7d3dd6c 00007f35a7e37c3e 00007f35a596efb4 00007f35a596ef42 00007f35a596ee71 00007f35a596edec 00007f35a596e0a2 00007f35a3c1894c 00007f35a3c17d86
0807 11:08:59.588667 (+ 3475us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2215710080}
I20260807 11:08:59.576740 25101 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:59.590154 25101 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:59.596927 24266 tablet_bootstrap.cc:492] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:59.597389 24266 ts_tablet_manager.cc:1397] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.101s user 0.010s sys 0.005s
W20260807 11:08:59.599949 23745 leader_election.cc:341] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:59.601229 23745 leader_election.cc:341] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.601562 23745 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:08:59.602263 25039 raft_consensus.cc:2726] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:59.603833 24266 raft_consensus.cc:348] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.607554 24852 raft_consensus.cc:482] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.612025 24642 ts_manager.cc:194] Registered new tserver with Master: 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:59.615693 24940 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e598bda106e4ec181b53fc7f305c822. Latest consensus state: current_term: 4 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:08:59.616571 24940 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:08:59.616592 24266 raft_consensus.cc:374] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.616879 24266 raft_consensus.cc:729] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.617940 24261 tablet_bootstrap.cc:492] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
W20260807 11:08:59.608891 23691 heartbeater.cc:415] Failed 1 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 11:08:59.617676 24266 consensus_queue.cc:260] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.618342 24261 ts_tablet_manager.cc:1397] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.072s user 0.017s sys 0.003s
I20260807 11:08:59.618364 23691 heartbeater.cc:464] Registering TS with master...
I20260807 11:08:59.617581 24852 raft_consensus.cc:504] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.623968 24266 ts_tablet_manager.cc:1428] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260807 11:08:59.627184 24266 tablet_bootstrap.cc:492] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:59.621023 24261 raft_consensus.cc:348] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.631461 24261 raft_consensus.cc:374] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.631703 24261 raft_consensus.cc:729] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
W20260807 11:08:59.632184 23029 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 64c4a0700315457384e3ca995de8a4f2 (table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 64c4a0700315457384e3ca995de8a4f2 consensus state has no leader
I20260807 11:08:59.633030 25028 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:59.633509 24261 consensus_queue.cc:260] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.635099 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:59.635712 23844 raft_consensus.cc:2454] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:59.640079 23507 leader_election.cc:302] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:59.640866 24844 raft_consensus.cc:2781] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:59.641319 24844 raft_consensus.cc:482] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:59.641824 24844 raft_consensus.cc:3037] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:59.647452 23954 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 8a2df15b35bd435baaf95a708ec85a37
I20260807 11:08:59.647641 24978 raft_consensus.cc:482] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.648226 23954 leader_election.cc:302] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:08:59.648262 24978 raft_consensus.cc:504] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.649293 25092 raft_consensus.cc:2726] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:08:59.650843 24978 leader_election.cc:288] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.652202 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:59.652827 23844 raft_consensus.cc:2454] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:59.652751 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:59.653823 23507 leader_election.cc:302] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:59.654630 24978 raft_consensus.cc:2781] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:59.654994 24978 raft_consensus.cc:482] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 11:08:59.655331 23510 leader_election.cc:341] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.655984 24852 leader_election.cc:288] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.657095 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:08:59.658655 23510 leader_election.cc:341] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.655359 24978 raft_consensus.cc:3037] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.660902 24266 tablet_bootstrap.cc:654] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:08:59.646517 24642 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.22.115.193:60519 (request call id 32) took 1058 ms (client timeout 1000 ms). Trace:
W20260807 11:08:59.663817 24642 rpcz_store.cc:269] 0807 11:08:58.588489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:58.595591 (+ 7102us) service_pool.cc:227] Handling call
0807 11:08:59.611150 (+1015559us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400030554. stack: 00007f359eee2033 00007f359eee1f30 00007f359ea63534 00000000004db2b4 00000000004db249 00007f35a5deeaf0 00007f35a5e71f2a 00007f35a7d3dd6c 00007f35a7e37c3e 00007f35a596efb4 00007f35a596ef42 00007f35a596ee71 00007f35a596edec 00007f35a596e0a2 00007f35a3c1894c 00007f35a3c17d86
0807 11:08:59.646447 (+ 35297us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2264879872}
W20260807 11:08:59.665899 24638 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.22.115.194:43321 (request call id 36) took 928 ms (client timeout 1000 ms). Trace:
W20260807 11:08:59.666373 24638 rpcz_store.cc:269] 0807 11:08:58.670793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:58.672641 (+ 1848us) service_pool.cc:227] Handling call
0807 11:08:59.593940 (+921299us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400030554. stack: 00007f359eee2033 00007f359eee1f30 00007f359ea63534 00000000004db2b4 00000000004db249 00007f35a5deeaf0 00007f35a5e71f2a 00007f35a7d3dd6c 00007f35a7e37c3e 00007f35a596efb4 00007f35a596ef42 00007f35a596ee71 00007f35a596edec 00007f35a596e0a2 00007f35a3c1894c 00007f35a3c17d86
0807 11:08:59.598726 (+ 4786us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2009122176}
I20260807 11:08:59.673575 24261 ts_tablet_manager.cc:1428] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.055s user 0.000s sys 0.010s
I20260807 11:08:59.674515 24261 tablet_bootstrap.cc:492] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:59.707653 24982 leader_election.cc:288] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.708863 24638 ts_descriptor.cc:144] Processing retry of TS registration from permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" instance_seqno: 1786100916332753
I20260807 11:08:59.709421 24638 ts_manager.cc:194] Re-registered known tserver with Master: 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:08:59.704641 24978 raft_consensus.cc:504] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.714361 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:59.710640 24844 raft_consensus.cc:504] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.714980 23844 raft_consensus.cc:3037] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.715169 24978 leader_election.cc:288] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.721052 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:59.722384 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:59.723089 23846 raft_consensus.cc:3037] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.724269 24844 leader_election.cc:288] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.727435 24261 tablet_bootstrap.cc:654] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.721052 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:08:59.730247 23510 leader_election.cc:341] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:08:59.730969 23510 leader_election.cc:341] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.735472 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:59.735790 24978 consensus_queue.cc:1035] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 11:08:59.738207 23510 leader_election.cc:341] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.747244 23841 raft_consensus.cc:2454] T cc48c13644a3401ab34dad398a7f5cd5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:59.748916 23507 leader_election.cc:302] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:59.749660 24844 raft_consensus.cc:2781] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:59.750229 24844 raft_consensus.cc:686] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:59.755466 24844 consensus_queue.cc:237] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.764663 23844 raft_consensus.cc:2454] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:59.775157 24261 tablet_bootstrap.cc:492] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:08:59.784654 25012 catalog_manager.cc:1259] Loaded cluster ID: 1fc1be4dcf034633aaea4c03e0988a11
I20260807 11:08:59.767032 24262 tablet_bootstrap.cc:492] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:08:59.785565 24262 ts_tablet_manager.cc:1397] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.497s user 0.015s sys 0.000s
I20260807 11:08:59.786765 23507 leader_election.cc:302] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:59.746764 23846 raft_consensus.cc:2454] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:59.787492 24852 raft_consensus.cc:2781] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:59.787899 24852 raft_consensus.cc:686] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:59.788476 24262 raft_consensus.cc:348] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.788607 24852 consensus_queue.cc:237] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.789126 24262 raft_consensus.cc:374] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.789362 24262 raft_consensus.cc:729] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
W20260807 11:08:59.796291 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 411665us
I20260807 11:08:59.798470 23507 leader_election.cc:302] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:08:59.799360 25066 consensus_queue.cc:1035] T 275ff54bfeae4fd3ad19e697a2b83e74 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:59.800202 24266 tablet_bootstrap.cc:492] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:08:59.800612 24266 ts_tablet_manager.cc:1397] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.174s user 0.015s sys 0.008s
I20260807 11:08:59.801007 25066 raft_consensus.cc:2781] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:08:59.801386 25066 raft_consensus.cc:686] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:08:59.802066 25066 consensus_queue.cc:237] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.831056 24266 raft_consensus.cc:348] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.831808 24266 raft_consensus.cc:374] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.832194 24266 raft_consensus.cc:729] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.832839 24266 consensus_queue.cc:260] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.835855 24262 consensus_queue.cc:260] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.863210 24262 ts_tablet_manager.cc:1428] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.077s user 0.006s sys 0.000s
I20260807 11:08:59.864199 24262 tablet_bootstrap.cc:492] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:08:59.864144 24261 ts_tablet_manager.cc:1397] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.190s user 0.012s sys 0.001s
I20260807 11:08:59.871593 24261 raft_consensus.cc:348] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.882634 24054 raft_consensus.cc:3037] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.887914 24852 raft_consensus.cc:482] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:08:59.888446 24852 raft_consensus.cc:504] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.891543 24852 leader_election.cc:288] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.892037 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:59.892671 23844 raft_consensus.cc:2454] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:59.893471 24261 raft_consensus.cc:374] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:08:59.893692 23507 leader_election.cc:302] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:59.893761 24261 raft_consensus.cc:729] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:08:59.894712 24852 raft_consensus.cc:2781] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:59.894894 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:59.895183 24852 raft_consensus.cc:482] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:59.895766 24852 raft_consensus.cc:3037] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:59.896281 23510 leader_election.cc:341] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.900573 24266 ts_tablet_manager.cc:1428] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.034s user 0.004s sys 0.000s
I20260807 11:08:59.903560 24978 consensus_queue.cc:1035] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:59.903409 24261 consensus_queue.cc:260] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.908007 24978 raft_consensus.cc:482] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:08:59.911880 25116 log.cc:924] Time spent T 275ff54bfeae4fd3ad19e697a2b83e74 P c281254655c84a0496c50045c37b22df: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260807 11:08:59.585928 24675 rpcz_store.cc:276] 0807 11:08:58.495659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:58.515048 (+ 19389us) service_pool.cc:227] Handling call
0807 11:08:58.571152 (+ 56104us) raft_consensus.cc:1457] Updating replica for 52 ops
0807 11:08:58.623442 (+ 52290us) raft_consensus.cc:1520] Early marking committed up to index 207
0807 11:08:58.623730 (+ 288us) raft_consensus.cc:1525] Triggering prepare for 52 ops
0807 11:08:58.624236 (+ 506us) write_op.cc:270] Start()
0807 11:08:58.624590 (+ 354us) write_op.cc:276] Timestamp: P: 1786100933788360 usec, L: 0
0807 11:08:58.626252 (+ 1662us) write_op.cc:270] Start()
0807 11:08:58.629292 (+ 3040us) write_op.cc:276] Timestamp: P: 1786100933812470 usec, L: 0
0807 11:08:58.629970 (+ 678us) write_op.cc:270] Start()
0807 11:08:58.630093 (+ 123us) write_op.cc:276] Timestamp: P: 1786100933857432 usec, L: 0
0807 11:08:58.655073 (+ 24980us) write_op.cc:270] Start()
0807 11:08:58.655167 (+ 94us) write_op.cc:276] Timestamp: P: 1786100933862439 usec, L: 0
0807 11:08:58.655742 (+ 575us) write_op.cc:270] Start()
0807 11:08:58.655858 (+ 116us) write_op.cc:276] Timestamp: P: 1786100933868281 usec, L: 0
0807 11:08:58.656531 (+ 673us) write_op.cc:270] Start()
0807 11:08:58.656644 (+ 113us) write_op.cc:276] Timestamp: P: 1786100934031331 usec, L: 0
0807 11:08:58.674151 (+ 17507us) write_op.cc:270] Start()
0807 11:08:58.720196 (+ 46045us) write_op.cc:276] Timestamp: P: 1786100934058479 usec, L: 0
0807 11:08:58.720979 (+ 783us) write_op.cc:270] Start()
0807 11:08:58.721101 (+ 122us) write_op.cc:276] Timestamp: P: 1786100934109068 usec, L: 0
0807 11:08:58.753331 (+ 32230us) write_op.cc:270] Start()
0807 11:08:58.753468 (+ 137us) write_op.cc:276] Timestamp: P: 1786100934126150 usec, L: 0
0807 11:08:58.777506 (+ 24038us) write_op.cc:270] Start()
0807 11:08:58.808486 (+ 30980us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b60000d01c8. stack: 00007f359eee2033 00007f359eee1f30 00007f359ea63534 00000000004db2b4 00000000004db249 00007f35a61fe361 00007f35a63633d3 00007f35a6365f6c 00007f35a6200083 00007f35a61dd9b6 00007f35a62db31a 00007f35a62c4bb2 00007f35a628bf96 00007f35a628bacf 00007f35a5e60040 00007f35a5e69536
0807 11:08:58.808576 (+ 90us) write_op.cc:276] Timestamp: P: 1786100934138077 usec, L: 0
0807 11:08:58.832648 (+ 24072us) write_op.cc:270] Start()
0807 11:08:58.834992 (+ 2344us) write_op.cc:276] Timestamp: P: 1786100934148062 usec, L: 0
0807 11:08:58.835574 (+ 582us) write_op.cc:270] Start()
0807 11:08:58.835675 (+ 101us) write_op.cc:276] Timestamp: P: 1786100934212485 usec, L: 0
0807 11:08:58.839829 (+ 4154us) write_op.cc:270] Start()
0807 11:08:58.839917 (+ 88us) write_op.cc:276] Timestamp: P: 1786100934238553 usec, L: 0
0807 11:08:58.840392 (+ 475us) write_op.cc:270] Start()
0807 11:08:58.847069 (+ 6677us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b60000d01c8. stack: 00007f359eee2033 00007f359eee1f30 00007f359ea63534 00000000004db2b4 00000000004db249 00007f35a61fe361 00007f35a63633d3 00007f35a6365f6c 00007f35a6200083 00007f35a61dd9b6 00007f35a62db31a 00007f35a62c4bb2 00007f35a628bf96 00007f35a628bacf 00007f35a5e60040 00007f35a5e69536
0807 11:08:58.847387 (+ 318us) write_op.cc:276] Timestamp: P: 1786100934241322 usec, L: 0
0807 11:08:58.847919 (+ 532us) write_op.cc:270] Start()
0807 11:08:58.848004 (+ 85us) write_op.cc:276] Timestamp: P: 1786100934334134 usec, L: 0
0807 11:08:58.848453 (+ 449us) write_op.cc:270] Start()
0807 11:08:58.848529 (+ 76us) write_op.cc:276] Timestamp: P: 1786100934394807 usec, L: 0
0807 11:08:58.861755 (+ 13226us) write_op.cc:270] Start()
0807 11:08:58.861846 (+ 91us) write_op.cc:276] Timestamp: P: 1786100934397753 usec, L: 0
0807 11:08:58.862377 (+ 531us) write_op.cc:270] Start()
0807 11:08:58.933359 (+ 70982us) write_op.cc:276] Timestamp: P: 1786100934484022 usec, L: 0
0807 11:08:58.934005 (+ 646us) write_op.cc:270] Start()
0807 11:08:58.934161 (+ 156us) write_op.cc:276] Timestamp: P: 1786100934486753 usec, L: 0
0807 11:08:58.934686 (+ 525us) write_op.cc:270] Start()
0807 11:08:58.934766 (+ 80us) write_op.cc:276] Timestamp: P: 1786100934517759 usec, L: 0
0807 11:08:58.935972 (+ 1206us) write_op.cc:270] Start()
0807 11:08:58.936066 (+ 94us) write_op.cc:276] Timestamp: P: 1786100934618447 usec, L: 0
0807 11:08:58.936520 (+ 454us) write_op.cc:270] Start()
0807 11:08:58.936606 (+ 86us) write_op.cc:276] Timestamp: P: 1786100934698602 usec, L: 0
0807 11:08:58.937017 (+ 411us) write_op.cc:270] Start()
0807 11:08:58.937091 (+ 74us) write_op.cc:276] Timestamp: P: 1786100934814417 usec, L: 0
0807 11:08:59.036629 (+ 99538us) write_op.cc:270] Start()
0807 11:08:59.036723 (+ 94us) write_op.cc:276] Timestamp: P: 1786100934836429 usec, L: 0
0807 11:08:59.037256 (+ 533us) write_op.cc:270] Start()
0807 11:08:59.037334 (+ 78us) write_op.cc:276] Timestamp: P: 1786100934860229 usec, L: 0
0807 11:08:59.037787 (+ 453us) write_op.cc:270] Start()
0807 11:08:59.037880 (+ 93us) write_op.cc:276] Timestamp: P: 1786100934861935 usec, L: 0
0807 11:08:59.062225 (+ 24345us) write_op.cc:270] Start()
0807 11:08:59.062368 (+ 143us) write_op.cc:276] Timestamp: P: 1786100934864067 usec, L: 0
0807 11:08:59.063087 (+ 719us) write_op.cc:270] Start()
0807 11:08:59.063174 (+ 87us) write_op.cc:276] Timestamp: P: 1786100934865563 usec, L: 0
0807 11:08:59.063949 (+ 775us) write_op.cc:270] Start()
0807 11:08:59.064064 (+ 115us) write_op.cc:276] Timestamp: P: 1786100934908428 usec, L: 0
0807 11:08:59.064787 (+ 723us) write_op.cc:270] Start()
0807 11:08:59.064889 (+ 102us) write_op.cc:276] Timestamp: P: 1786100935201254 usec, L: 0
0807 11:08:59.065594 (+ 705us) write_op.cc:270] Start()
0807 11:08:59.065687 (+ 93us) write_op.cc:276] Timestamp: P: 1786100935257019 usec, L: 0
0807 11:08:59.172300 (+106613us) write_op.cc:270] Start()
0807 11:08:59.172515 (+ 215us) write_op.cc:276] Timestamp: P: 1786100935281591 usec, L: 0
0807 11:08:59.173380 (+ 865us) write_op.cc:270] Start()
0807 11:08:59.173564 (+ 184us) write_op.cc:276] Timestamp: P: 1786100935285261 usec, L: 0
0807 11:08:59.174260 (+ 696us) write_op.cc:270] Start()
0807 11:08:59.174358 (+ 98us) write_op.cc:276] Timestamp: P: 1786100935369576 usec, L: 0
0807 11:08:59.215807 (+ 41449us) write_op.cc:270] Start()
0807 11:08:59.215903 (+ 96us) write_op.cc:276] Timestamp: P: 1786100935400511 usec, L: 0
0807 11:08:59.216459 (+ 556us) write_op.cc:270] Start()
0807 11:08:59.216540 (+ 81us) write_op.cc:276] Timestamp: P: 1786100935449053 usec, L: 0
0807 11:08:59.217024 (+ 484us) write_op.cc:270] Start()
0807 11:08:59.217107 (+ 83us) write_op.cc:276] Timestamp: P: 1786100935451907 usec, L: 0
0807 11:08:59.217587 (+ 480us) write_op.cc:270] Start()
0807 11:08:59.217677 (+ 90us) write_op.cc:276] Timestamp: P: 1786100935485276 usec, L: 0
0807 11:08:59.218157 (+ 480us) write_op.cc:270] Start()
0807 11:08:59.218249 (+ 92us) write_op.cc:276] Timestamp: P: 1786100935496618 usec, L: 0
0807 11:08:59.218711 (+ 462us) write_op.cc:270] Start()
0807 11:08:59.218785 (+ 74us) write_op.cc:276] Timestamp: P: 1786100935594397 usec, L: 0
0807 11:08:59.244252 (+ 25467us) write_op.cc:270] Start()
0807 11:08:59.244563 (+ 311us) write_op.cc:276] Timestamp: P: 1786100935610864 usec, L: 0
0807 11:08:59.279560 (+ 34997us) write_op.cc:270] Start()
0807 11:08:59.279668 (+ 108us) write_op.cc:276] Timestamp: P: 1786100935625271 usec, L: 0
0807 11:08:59.280197 (+ 529us) write_op.cc:270] Start()
0807 11:08:59.280275 (+ 78us) write_op.cc:276] Timestamp: P: 1786100935826138 usec, L: 0
0807 11:08:59.280725 (+ 450us) write_op.cc:270] Start()
0807 11:08:59.280805 (+ 80us) write_op.cc:276] Timestamp: P: 1786100936252685 usec, L: 0
0807 11:08:59.281287 (+ 482us) write_op.cc:270] Start()
0807 11:08:59.281373 (+ 86us) write_op.cc:276] Timestamp: P: 1786100936267546 usec, L: 0
0807 11:08:59.281809 (+ 436us) write_op.cc:270] Start()
0807 11:08:59.281883 (+ 74us) write_op.cc:276] Timestamp: P: 1786100936269465 usec, L: 0
0807 11:08:59.282330 (+ 447us) write_op.cc:270] Start()
0807 11:08:59.282411 (+ 81us) write_op.cc:276] Timestamp: P: 1786100936286312 usec, L: 0
0807 11:08:59.305817 (+ 23406us) write_op.cc:270] Start()
0807 11:08:59.320309 (+ 14492us) write_op.cc:276] Timestamp: P: 1786100936316593 usec, L: 0
0807 11:08:59.321010 (+ 701us) write_op.cc:270] Start()
0807 11:08:59.321110 (+ 100us) write_op.cc:276] Timestamp: P: 1786100936319422 usec, L: 0
0807 11:08:59.321585 (+ 475us) write_op.cc:270] Start()
0807 11:08:59.321665 (+ 80us) write_op.cc:276] Timestamp: P: 1786100936387773 usec, L: 0
0807 11:08:59.322104 (+ 439us) write_op.cc:270] Start()
0807 11:08:59.322183 (+ 79us) write_op.cc:276] Timestamp: P: 1786100936808255 usec, L: 0
0807 11:08:59.421474 (+ 99291us) log.cc:842] Serialized 34060 byte log entry
0807 11:08:59.453602 (+ 32128us) raft_consensus.cc:1631] Marking committed up to 259
0807 11:08:59.552144 (+ 98542us) log.cc:842] Serialized 15 byte log entry
0807 11:08:59.571041 (+ 18897us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 11:08:59.572178 (+ 1137us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 11:08:59.574263 (+ 2085us) raft_consensus.cc:1671] finished
0807 11:08:59.575075 (+ 812us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 11:08:59.579559 (+ 4484us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:08:59.453834 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.454042 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.454238 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.454392 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.454557 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.454662 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.454802 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.454982 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.455116 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.455263 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.455376 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.455515 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.455659 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.455782 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.455925 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.456014 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.456170 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.456349 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.456537 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.456706 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.456811 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.456974 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.457131 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.496177 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.498909 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.501659 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.502895 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.512802 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.512950 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.513038 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.513119 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.513199 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.513275 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.514813 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.518801 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.519809 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.520663 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.521848 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.523209 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.524970 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.527164 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.528725 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.530579 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.533275 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.534602 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.536280 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.538039 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.539537 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.540787 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.546670 (+ 0us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 11:08:59.548581 (+ 0us) op_driver.cc:444] REPLICATION: finished
Metrics: {"raft.queue_time_us":65368,"raft.run_cpu_time_us":10639,"raft.run_wall_time_us":1011716,"spinlock_wait_cycles":2317441792,"thread_start_us":10181,"threads_started":1,"child_traces":[["op",{"replication_time_us":829534}],["op",{"replication_time_us":827686}],["op",{"replication_time_us":824161}],["op",{"replication_time_us":799223}],["op",{"replication_time_us":798748}],["op",{"replication_time_us":798086}],["op",{"replication_time_us":780620}],["op",{"replication_time_us":733931}],["op",{"replication_time_us":701721}],["op",{"replication_time_us":677721}],["op",{"replication_time_us":622682}],["op",{"replication_time_us":619902}],["op",{"replication_time_us":615737}],["op",{"replication_time_us":615317}],["op",{"replication_time_us":607938}],["op",{"replication_time_us":607521}],["op",{"replication_time_us":594355}],["op",{"replication_time_us":593900}],["op",{"replication_time_us":522542}],["op",{"replication_time_us":521960}],["op",{"replication_time_us":520794}],["op",{"replication_time_us":520386}],["op",{"replication_time_us":520070}],["op",{"replication_time_us":456479}],["op",{"replication_time_us":460708}],["op",{"replication_time_us":463056}],["op",{"replication_time_us":440232}],["op",{"replication_time_us":439872}],["op",{"replication_time_us":448954}],["op",{"replication_time_us":448225}],["op",{"replication_time_us":447492}],["op",{"replication_time_us":340875}],["op",{"replication_time_us":339869}],["op",{"replication_time_us":339095}],["op",{"replication_time_us":302296}],["op",{"replication_time_us":302744}],["op",{"replication_time_us":303211}],["op",{"replication_time_us":303401}],["op",{"replication_time_us":304172}],["op",{"replication_time_us":305456}],["op",{"replication_time_us":281873}],["op",{"replication_time_us":248504}],["op",{"replication_time_us":249319}],["op",{"replication_time_us":250993}],["op",{"replication_time_us":252659}],["op",{"replication_time_us":253646}],["op",{"replication_time_us":254629}],["op",{"replication_time_us":233019}],["op",{"replication_time_us":219200}],["op",{"replication_time_us":219773}],["op",{"replication_time_us":225497}]]}
I20260807 11:08:59.908409 24978 raft_consensus.cc:504] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.927790 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:08:59.928411 23844 raft_consensus.cc:2454] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:08:59.929487 23507 leader_election.cc:302] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:08:59.930203 24978 leader_election.cc:288] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:08:59.930778 24978 raft_consensus.cc:2781] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:08:59.931360 24978 raft_consensus.cc:482] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:08:59.931732 24978 raft_consensus.cc:3037] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.935642 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:08:59.937589 24057 raft_consensus.cc:3037] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:08:59.939226 23510 leader_election.cc:341] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.945640 24852 raft_consensus.cc:504] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:08:59.949275 24852 leader_election.cc:288] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:08:59.953128 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:08:59.954360 23846 raft_consensus.cc:3037] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:08:59.962283 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:08:59.947361 24261 ts_tablet_manager.cc:1428] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.083s user 0.006s sys 0.000s
W20260807 11:08:59.965690 23510 leader_election.cc:341] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.971695 24261 tablet_bootstrap.cc:492] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:08:59.975168 23846 raft_consensus.cc:2454] T 06a5e42d83ac4becb19a55d21040a3cc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:08:59.976104 24266 tablet_bootstrap.cc:492] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:08:59.977629 24261 tablet_bootstrap.cc:654] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.981356 24266 tablet_bootstrap.cc:654] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:08:59.980926 24978 raft_consensus.cc:504] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:08:59.918982 25012 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: loading cluster ID for follower catalog manager: success
I20260807 11:08:59.982831 24978 leader_election.cc:288] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.010022 24261 tablet_bootstrap.cc:492] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:00.010560 24261 ts_tablet_manager.cc:1397] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.001s
I20260807 11:09:00.017357 24261 raft_consensus.cc:348] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.018219 24261 raft_consensus.cc:374] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.018522 24261 raft_consensus.cc:729] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.022341 24261 consensus_queue.cc:260] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:00.024881 23142 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.714s (SENT)
I20260807 11:09:00.035336 24261 ts_tablet_manager.cc:1428] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260807 11:09:00.043577 24261 tablet_bootstrap.cc:492] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:00.064141 24978 consensus_queue.cc:1035] T 9cd1107ba80a4dbeaba696a7b7095423 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:08:59.984011 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:00.066018 23844 raft_consensus.cc:3037] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.066613 24978 raft_consensus.cc:482] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.067168 24978 raft_consensus.cc:504] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.069356 24978 leader_election.cc:288] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:00.071684 24261 tablet_bootstrap.cc:654] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.075354 23844 raft_consensus.cc:2454] T cc36c0c8fded4ac6991b98c132b17e56 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
W20260807 11:09:00.073391 23507 leader_election.cc:341] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5fb920ddfaaa423387c98112b52fc2e7
I20260807 11:09:00.079494 23507 leader_election.cc:302] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:00.080726 24978 raft_consensus.cc:2781] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:00.081324 23507 leader_election.cc:302] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:00.081568 24978 raft_consensus.cc:686] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:00.082058 24852 raft_consensus.cc:2781] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:00.082610 24852 raft_consensus.cc:686] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:00.082412 24978 consensus_queue.cc:237] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.083623 24852 consensus_queue.cc:237] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:09:00.092157 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 67399.3us
I20260807 11:09:00.042121 24262 tablet_bootstrap.cc:654] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.123970 24982 raft_consensus.cc:482] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.124442 24982 raft_consensus.cc:504] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.126362 24982 leader_election.cc:288] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.128219 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:00.128873 23846 raft_consensus.cc:2454] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:00.130343 23507 leader_election.cc:302] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:00.131888 24852 raft_consensus.cc:2781] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:00.132196 24852 raft_consensus.cc:482] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:00.132493 24852 raft_consensus.cc:3037] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.140126 25028 raft_consensus.cc:482] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.140576 25028 raft_consensus.cc:504] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.142479 25028 leader_election.cc:288] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:00.160943 24852 raft_consensus.cc:504] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.173517 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:00.174173 23846 raft_consensus.cc:3037] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.176254 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:00.179872 24262 tablet_bootstrap.cc:492] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:00.180997 24262 ts_tablet_manager.cc:1397] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.317s user 0.026s sys 0.005s
I20260807 11:09:00.181722 24852 leader_election.cc:288] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.181268 23846 raft_consensus.cc:2454] T 912026edd2664386880028a5958a993c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:00.192427 23507 leader_election.cc:302] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:00.192421 25093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "7e598bda106e4ec181b53fc7f305c822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } } }
I20260807 11:09:00.193172 25093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822 [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:00.196199 24852 raft_consensus.cc:2781] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:00.196913 24852 raft_consensus.cc:686] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:00.197674 24852 consensus_queue.cc:237] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.207736 24261 tablet_bootstrap.cc:492] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:00.208150 24261 ts_tablet_manager.cc:1397] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.165s user 0.025s sys 0.018s
I20260807 11:09:00.210345 24261 raft_consensus.cc:348] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.210958 24261 raft_consensus.cc:374] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.211191 24261 raft_consensus.cc:729] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.213977 24261 consensus_queue.cc:260] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.207764 25012 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: acquiring CA information for follower catalog manager: success
W20260807 11:09:00.217756 23745 leader_election.cc:341] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.220139 24262 raft_consensus.cc:348] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.220914 24262 raft_consensus.cc:374] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.221319 24262 raft_consensus.cc:729] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.221990 24262 consensus_queue.cc:260] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.224289 24262 ts_tablet_manager.cc:1428] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.043s user 0.003s sys 0.002s
I20260807 11:09:00.234014 24261 ts_tablet_manager.cc:1428] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20260807 11:09:00.237052 24261 tablet_bootstrap.cc:492] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:00.237192 24262 tablet_bootstrap.cc:492] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:00.248148 24261 tablet_bootstrap.cc:654] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.247933 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:00.249953 23510 leader_election.cc:341] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.251199 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:00.252585 23510 leader_election.cc:341] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:08:59.987602 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:00.255124 24262 tablet_bootstrap.cc:654] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.255684 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:00.257021 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb920ddfaaa423387c98112b52fc2e7" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:00.259459 23745 leader_election.cc:341] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.259891 23745 leader_election.cc:302] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:00.260569 25139 raft_consensus.cc:2726] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:00.261665 23510 leader_election.cc:341] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:00.262835 23510 leader_election.cc:341] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.263193 23510 leader_election.cc:302] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:09:00.267016 24978 raft_consensus.cc:2726] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:00.274178 24262 tablet_bootstrap.cc:492] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:00.284934 24262 ts_tablet_manager.cc:1397] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.001s
I20260807 11:09:00.292515 24846 raft_consensus.cc:482] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.293478 24846 raft_consensus.cc:504] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.297327 24846 leader_election.cc:288] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.298070 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:00.300520 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02d17f09961641ca8c4d5a64f0fcadf8" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:00.301326 23840 raft_consensus.cc:2379] T 02d17f09961641ca8c4d5a64f0fcadf8 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:00.303700 24262 raft_consensus.cc:348] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.304407 24262 raft_consensus.cc:374] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.304664 24262 raft_consensus.cc:729] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.307746 25139 raft_consensus.cc:482] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.308162 25139 raft_consensus.cc:504] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.310158 25139 leader_election.cc:288] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:00.318835 24261 tablet_bootstrap.cc:492] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:00.323587 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:00.324277 24261 ts_tablet_manager.cc:1397] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.089s user 0.014s sys 0.000s
W20260807 11:09:00.325578 23745 leader_election.cc:341] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.326999 24261 raft_consensus.cc:348] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.327809 24261 raft_consensus.cc:374] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.328068 24261 raft_consensus.cc:729] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.331091 25139 raft_consensus.cc:482] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.331612 25139 raft_consensus.cc:504] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.337592 24261 consensus_queue.cc:260] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.341482 24261 ts_tablet_manager.cc:1428] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260807 11:09:00.342324 24261 tablet_bootstrap.cc:492] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:00.350822 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a7ccf34faf345998028f67921927f0e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:00.352104 23745 leader_election.cc:341] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.351332 25139 leader_election.cc:288] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:00.354437 24261 tablet_bootstrap.cc:654] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.360747 23951 leader_election.cc:302] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:00.363250 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a7ccf34faf345998028f67921927f0e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:00.363461 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:00.362017 25092 raft_consensus.cc:3037] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:00.367947 23745 leader_election.cc:341] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.368366 23745 leader_election.cc:302] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
W20260807 11:09:00.369556 23745 leader_election.cc:341] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.369906 23745 leader_election.cc:302] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:00.379900 25028 raft_consensus.cc:2726] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:00.380054 25092 raft_consensus.cc:2726] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:00.380532 25028 raft_consensus.cc:2726] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:00.381367 24978 raft_consensus.cc:482] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.381804 24978 raft_consensus.cc:504] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.383662 24978 leader_election.cc:288] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:00.385835 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36b812880814298990c9aee6999f113" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:00.386487 23846 raft_consensus.cc:2454] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:00.387679 23507 leader_election.cc:302] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:00.388720 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36b812880814298990c9aee6999f113" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:00.389309 24978 raft_consensus.cc:2781] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:00.390887 24978 raft_consensus.cc:482] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:00.391263 24978 raft_consensus.cc:3037] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.391438 24262 consensus_queue.cc:260] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:00.390511 23510 leader_election.cc:341] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.403705 24978 raft_consensus.cc:504] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.409281 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36b812880814298990c9aee6999f113" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:00.409865 23846 raft_consensus.cc:3037] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.440462 23846 raft_consensus.cc:2454] T f36b812880814298990c9aee6999f113 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:00.441723 23507 leader_election.cc:302] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:00.443084 24852 raft_consensus.cc:2781] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:00.443836 24852 raft_consensus.cc:686] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:00.444639 24852 consensus_queue.cc:237] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.447206 24262 ts_tablet_manager.cc:1428] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.162s user 0.004s sys 0.002s
I20260807 11:09:00.448248 24262 tablet_bootstrap.cc:492] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:00.451736 24844 raft_consensus.cc:482] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.452172 24844 raft_consensus.cc:504] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.454031 24844 leader_election.cc:288] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.455540 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f41042d50184ecf9bbd2c225c86aabf" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:00.456867 23510 leader_election.cc:341] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.457216 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f41042d50184ecf9bbd2c225c86aabf" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:00.457948 23846 raft_consensus.cc:2454] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:00.459062 23507 leader_election.cc:302] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:00.459986 24844 raft_consensus.cc:2781] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:00.460282 24844 raft_consensus.cc:482] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:00.460553 24844 raft_consensus.cc:3037] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.470326 24844 raft_consensus.cc:504] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.473222 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f41042d50184ecf9bbd2c225c86aabf" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:00.474397 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f41042d50184ecf9bbd2c225c86aabf" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
W20260807 11:09:00.474673 23510 leader_election.cc:341] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.475015 23840 raft_consensus.cc:3037] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.484807 23840 raft_consensus.cc:2454] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:00.488150 23507 leader_election.cc:302] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:00.488862 25066 raft_consensus.cc:2781] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:00.489317 25066 raft_consensus.cc:686] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:00.490126 25066 consensus_queue.cc:237] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:00.496879 23951 consensus_peers.cc:487] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84c78502f0a5485c9ffe4434c14567e0. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:00.516947 24266 tablet_bootstrap.cc:492] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:00.517416 24266 ts_tablet_manager.cc:1397] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.541s user 0.006s sys 0.006s
I20260807 11:09:00.520138 24266 raft_consensus.cc:348] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.520843 24266 raft_consensus.cc:374] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.521133 24266 raft_consensus.cc:729] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.522001 24262 tablet_bootstrap.cc:654] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.521850 24266 consensus_queue.cc:260] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.524215 24266 ts_tablet_manager.cc:1428] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260807 11:09:00.514312 25012 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 11:09:00.537274 24266 tablet_bootstrap.cc:492] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:00.561370 24266 tablet_bootstrap.cc:654] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.563522 24844 leader_election.cc:288] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.572535 24261 tablet_bootstrap.cc:492] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:00.573024 24261 ts_tablet_manager.cc:1397] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.231s user 0.012s sys 0.003s
I20260807 11:09:00.575518 24261 raft_consensus.cc:348] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.576473 24261 raft_consensus.cc:374] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.577396 24261 raft_consensus.cc:729] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.571280 24978 leader_election.cc:288] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:00.562335 25092 consensus_queue.cc:1035] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:00.569886 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f36b812880814298990c9aee6999f113" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:00.580265 23510 leader_election.cc:341] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.605856 24261 consensus_queue.cc:260] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.612457 24261 ts_tablet_manager.cc:1428] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.039s user 0.004s sys 0.000s
I20260807 11:09:00.619053 24262 tablet_bootstrap.cc:492] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:00.620254 24262 ts_tablet_manager.cc:1397] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.172s user 0.005s sys 0.009s
I20260807 11:09:00.621150 24266 tablet_bootstrap.cc:492] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:00.621614 24266 ts_tablet_manager.cc:1397] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.085s user 0.011s sys 0.000s
I20260807 11:09:00.628458 24266 raft_consensus.cc:348] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.633142 24266 raft_consensus.cc:374] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.633486 24266 raft_consensus.cc:729] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.634233 24266 consensus_queue.cc:260] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.650156 24266 ts_tablet_manager.cc:1428] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260807 11:09:00.651863 24261 tablet_bootstrap.cc:492] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:00.660164 24266 tablet_bootstrap.cc:492] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:00.660071 24978 consensus_queue.cc:1035] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:00.670835 24262 raft_consensus.cc:348] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.685710 24846 raft_consensus.cc:482] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.686369 24846 raft_consensus.cc:504] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:00.687234 23510 consensus_peers.cc:487] T cc48c13644a3401ab34dad398a7f5cd5 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:00.688954 24846 leader_election.cc:288] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.689265 24261 tablet_bootstrap.cc:654] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.686818 24262 raft_consensus.cc:374] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.690407 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:00.690660 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f3bad2ba5e4178b29f52cfb53259db" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:00.691458 23846 raft_consensus.cc:2379] T f4f3bad2ba5e4178b29f52cfb53259db P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:00.692622 23951 leader_election.cc:302] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:00.690198 24262 raft_consensus.cc:729] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.693408 24846 raft_consensus.cc:3037] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.700609 24262 consensus_queue.cc:260] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.706842 22991 master-stress-test.cc:578] Killing test thread 1/10
I20260807 11:09:00.716524 24846 raft_consensus.cc:2726] T f4f3bad2ba5e4178b29f52cfb53259db P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:00.719970 24844 raft_consensus.cc:482] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.720500 24844 raft_consensus.cc:504] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.723893 24844 leader_election.cc:288] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.723012 25164 raft_consensus.cc:482] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.725188 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2013df97d54d43aaa844154c200a5a4f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:00.728016 23510 leader_election.cc:341] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.725943 24266 tablet_bootstrap.cc:654] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:00.731559 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2013df97d54d43aaa844154c200a5a4f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:00.729915 24262 ts_tablet_manager.cc:1428] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.108s user 0.013s sys 0.001s
I20260807 11:09:00.732523 23846 raft_consensus.cc:2454] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:00.729336 25164 raft_consensus.cc:504] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:00.733737 23507 leader_election.cc:302] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:00.734560 24978 raft_consensus.cc:2781] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:00.735097 24978 raft_consensus.cc:482] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:00.735498 24978 raft_consensus.cc:3037] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:00.741912 23954 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
I20260807 11:09:00.743777 25164 leader_election.cc:288] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:00.745685 24978 raft_consensus.cc:504] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.751506 25139 raft_consensus.cc:482] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.751963 25139 raft_consensus.cc:504] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.748037 24262 tablet_bootstrap.cc:492] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:00.756548 25139 leader_election.cc:288] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:00.759290 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:00.761462 23745 leader_election.cc:341] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:00.762697 23951 consensus_peers.cc:487] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64cb221021564d66bfecf5cd91bcec5c. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:00.765986 23951 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
I20260807 11:09:00.766337 23951 leader_election.cc:302] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:00.767588 25164 raft_consensus.cc:2726] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:00.773000 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:00.774534 24266 tablet_bootstrap.cc:492] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
W20260807 11:09:00.774660 23745 leader_election.cc:341] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.775048 23745 leader_election.cc:302] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:00.780102 24844 consensus_queue.cc:1035] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:00.780894 24978 leader_election.cc:288] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.787017 25139 raft_consensus.cc:2726] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:00.786906 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2013df97d54d43aaa844154c200a5a4f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:00.788066 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2013df97d54d43aaa844154c200a5a4f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
W20260807 11:09:00.788582 23510 leader_election.cc:341] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.788769 23846 raft_consensus.cc:3037] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.794128 24844 consensus_queue.cc:1035] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:00.797871 24261 tablet_bootstrap.cc:492] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:00.798275 24261 ts_tablet_manager.cc:1397] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.156s user 0.004s sys 0.010s
I20260807 11:09:00.801005 24261 raft_consensus.cc:348] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.801647 24261 raft_consensus.cc:374] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.801887 24261 raft_consensus.cc:729] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.802453 24261 consensus_queue.cc:260] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.805197 25166 consensus_queue.cc:1035] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 11:09:00.811419 23142 leader_election.cc:334] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.714s (SENT)
I20260807 11:09:00.811846 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:00.829295 24261 ts_tablet_manager.cc:1428] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.031s user 0.002s sys 0.004s
I20260807 11:09:00.830247 24261 tablet_bootstrap.cc:492] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:00.777212 24266 ts_tablet_manager.cc:1397] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.117s user 0.006s sys 0.007s
I20260807 11:09:00.840184 24844 consensus_queue.cc:1035] T 02d17f09961641ca8c4d5a64f0fcadf8 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:00.858191 24978 raft_consensus.cc:482] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.858825 24978 raft_consensus.cc:504] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.859778 24852 consensus_queue.cc:1035] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:00.861641 24978 leader_election.cc:288] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:00.863726 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:00.865468 23510 leader_election.cc:341] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.868377 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:00.869098 23837 raft_consensus.cc:2454] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:00.870116 23846 raft_consensus.cc:2454] T 2013df97d54d43aaa844154c200a5a4f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:00.870330 23507 leader_election.cc:302] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:00.872788 24852 raft_consensus.cc:2781] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:00.873205 24852 raft_consensus.cc:482] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:00.873575 24852 raft_consensus.cc:3037] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:00.887480 24844 consensus_queue.cc:1035] T f4f3bad2ba5e4178b29f52cfb53259db P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 11:09:00.891847 23027 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 912026edd2664386880028a5958a993c (table default.Table_0e391a540a1f4eb09798376daa1dd533 [id=01bc2a49d75f4d11bbbb6a644e2498b3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 912026edd2664386880028a5958a993c consensus state has no leader
I20260807 11:09:00.901062 23507 leader_election.cc:302] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:00.901760 24982 raft_consensus.cc:2781] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:00.901895 25139 raft_consensus.cc:482] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.902405 25139 raft_consensus.cc:504] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.903193 25166 raft_consensus.cc:482] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:00.903681 25166 raft_consensus.cc:504] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:00.904924 25139 leader_election.cc:288] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:00.908852 25166 leader_election.cc:288] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:00.911566 23951 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
W20260807 11:09:00.915779 23954 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
I20260807 11:09:00.916256 23954 leader_election.cc:302] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:00.917275 25166 raft_consensus.cc:2726] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:00.935954 24852 raft_consensus.cc:504] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:00.950439 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 139056us
I20260807 11:09:00.950475 25172 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:00.960685 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:00.962623 23510 consensus_peers.cc:487] T cc36c0c8fded4ac6991b98c132b17e56 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:00.963507 23510 leader_election.cc:341] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:00.970988 24266 raft_consensus.cc:348] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.971958 24266 raft_consensus.cc:374] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:00.972349 24266 raft_consensus.cc:729] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:00.973061 24266 consensus_queue.cc:260] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:00.975805 24266 ts_tablet_manager.cc:1428] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.144s user 0.006s sys 0.001s
I20260807 11:09:00.995600 24852 leader_election.cc:288] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.008934 24266 tablet_bootstrap.cc:492] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:01.011255 24982 raft_consensus.cc:686] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:01.012426 24982 consensus_queue.cc:237] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.017406 24266 tablet_bootstrap.cc:654] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.027125 24261 tablet_bootstrap.cc:654] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.037294 24266 tablet_bootstrap.cc:492] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:01.037762 24266 ts_tablet_manager.cc:1397] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.008s
I20260807 11:09:01.040424 24266 raft_consensus.cc:348] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.042407 24266 raft_consensus.cc:374] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.042724 24266 raft_consensus.cc:729] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.043527 24266 consensus_queue.cc:260] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.053027 24844 consensus_queue.cc:1035] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:01.055711 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:01.056522 23840 raft_consensus.cc:3037] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:00.983211 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 81760.3us
I20260807 11:09:01.064093 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:01.064771 23614 raft_consensus.cc:2454] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:09:01.062659 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:01.069633 23745 leader_election.cc:341] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:01.071457 23745 leader_election.cc:302] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:01.073426 24266 ts_tablet_manager.cc:1428] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.035s user 0.002s sys 0.003s
I20260807 11:09:01.074587 25139 raft_consensus.cc:2781] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:01.075006 25139 raft_consensus.cc:482] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:01.075428 25139 raft_consensus.cc:3037] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.076108 24262 tablet_bootstrap.cc:654] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:01.076547 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 91961.9us
W20260807 11:09:01.080816 23510 consensus_peers.cc:487] T 06a5e42d83ac4becb19a55d21040a3cc P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:01.084113 25166 raft_consensus.cc:482] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.084621 25166 raft_consensus.cc:504] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.086691 25166 leader_election.cc:288] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.091502 24266 tablet_bootstrap.cc:492] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:01.102077 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:01.104679 24261 tablet_bootstrap.cc:492] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:01.105074 24261 ts_tablet_manager.cc:1397] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.275s user 0.012s sys 0.001s
I20260807 11:09:01.107577 24261 raft_consensus.cc:348] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.108201 24261 raft_consensus.cc:374] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.108464 24261 raft_consensus.cc:729] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.119905 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0ee41a2c21548e7961b3884e8c7a4ff" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:01.122499 23951 leader_election.cc:302] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.139597 25139 raft_consensus.cc:504] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.151530 24261 consensus_queue.cc:260] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.154004 24261 ts_tablet_manager.cc:1428] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.049s user 0.006s sys 0.000s
I20260807 11:09:01.155027 24261 tablet_bootstrap.cc:492] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:01.181125 23840 raft_consensus.cc:2454] T cc365534189d493a9f3d28bbd4214544 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:01.142499 25139 leader_election.cc:288] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:01.186723 25166 raft_consensus.cc:2726] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:01.167835 25193 log.cc:924] Time spent T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93: Append to log took a long time: real 0.069s user 0.000s sys 0.001s
I20260807 11:09:01.182264 23507 leader_election.cc:302] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:01.188879 25200 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:01.189699 25200 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:01.191398 24852 raft_consensus.cc:2781] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 11:09:01.186794 23951 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 64382.2us
I20260807 11:09:01.192952 24852 raft_consensus.cc:686] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:01.193678 24852 consensus_queue.cc:237] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.199630 24266 tablet_bootstrap.cc:654] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.213601 24266 tablet_bootstrap.cc:492] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:01.213994 24266 ts_tablet_manager.cc:1397] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.123s user 0.007s sys 0.008s
I20260807 11:09:01.217129 24266 raft_consensus.cc:348] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.217778 24266 raft_consensus.cc:374] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.218027 24266 raft_consensus.cc:729] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.222291 23187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:09:01.226945 25200 leader_election.cc:288] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309)
I20260807 11:09:01.218619 24266 consensus_queue.cc:260] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.231791 24266 ts_tablet_manager.cc:1428] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.018s user 0.004s sys 0.004s
I20260807 11:09:01.234915 24262 tablet_bootstrap.cc:492] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:01.235183 24266 tablet_bootstrap.cc:492] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:01.235818 24262 ts_tablet_manager.cc:1397] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.490s user 0.016s sys 0.011s
I20260807 11:09:01.254948 24261 tablet_bootstrap.cc:654] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.258903 25166 raft_consensus.cc:482] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.259328 25166 raft_consensus.cc:504] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.261230 25166 leader_election.cc:288] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:01.265560 23951 leader_election.cc:341] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5fb920ddfaaa423387c98112b52fc2e7
I20260807 11:09:01.262209 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb920ddfaaa423387c98112b52fc2e7" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:01.271206 23614 raft_consensus.cc:2454] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
I20260807 11:09:01.265630 24982 consensus_queue.cc:1035] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:01.275867 23954 leader_election.cc:302] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
W20260807 11:09:01.276818 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 205410us
I20260807 11:09:01.277045 25166 raft_consensus.cc:2781] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:01.277350 25166 raft_consensus.cc:482] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:01.277647 25166 raft_consensus.cc:3037] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.280720 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:01.281330 23614 raft_consensus.cc:3037] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.292258 25139 raft_consensus.cc:482] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.292776 25139 raft_consensus.cc:504] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.294739 25139 leader_election.cc:288] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:01.301321 25166 raft_consensus.cc:504] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.302021 24261 tablet_bootstrap.cc:492] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:01.302438 24261 ts_tablet_manager.cc:1397] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.148s user 0.011s sys 0.002s
I20260807 11:09:01.302382 24846 raft_consensus.cc:482] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.304095 24846 raft_consensus.cc:504] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.306044 24846 leader_election.cc:288] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.306344 24261 raft_consensus.cc:348] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.306986 24261 raft_consensus.cc:374] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.307212 24261 raft_consensus.cc:729] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
W20260807 11:09:01.310153 23954 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 0071aac25afa4100b98c4811cf3e6b2e
W20260807 11:09:01.311210 23951 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:09:01.311553 23951 leader_election.cc:302] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.313158 24846 raft_consensus.cc:2726] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:01.315171 23614 raft_consensus.cc:2454] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:09:01.303694 24266 tablet_bootstrap.cc:654] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:01.322387 23951 leader_election.cc:341] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5fb920ddfaaa423387c98112b52fc2e7
I20260807 11:09:01.322192 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:01.323091 24261 consensus_queue.cc:260] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.298785 24262 raft_consensus.cc:348] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.329136 24261 ts_tablet_manager.cc:1428] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.026s user 0.003s sys 0.003s
I20260807 11:09:01.332288 24261 tablet_bootstrap.cc:492] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:01.328125 24262 raft_consensus.cc:374] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.337007 25166 leader_election.cc:288] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.337879 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb920ddfaaa423387c98112b52fc2e7" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:01.338892 23614 raft_consensus.cc:3037] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.340152 24262 raft_consensus.cc:729] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.349519 24982 consensus_queue.cc:1035] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:01.362018 23745 leader_election.cc:302] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:01.363881 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:01.367540 23510 consensus_peers.cc:487] T 912026edd2664386880028a5958a993c P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:01.368467 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:01.375101 25139 raft_consensus.cc:2781] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:01.375658 25139 raft_consensus.cc:686] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:09:01.377285 25139 consensus_queue.cc:237] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.358507 24262 consensus_queue.cc:260] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:01.383684 23745 leader_election.cc:341] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:01.392642 24261 tablet_bootstrap.cc:654] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.409154 24266 tablet_bootstrap.cc:492] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:01.409642 24266 ts_tablet_manager.cc:1397] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.175s user 0.005s sys 0.004s
I20260807 11:09:01.413537 24266 raft_consensus.cc:348] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.414295 24266 raft_consensus.cc:374] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.410756 24262 ts_tablet_manager.cc:1428] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.174s user 0.014s sys 0.002s
I20260807 11:09:01.414551 24266 raft_consensus.cc:729] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.433223 24261 tablet_bootstrap.cc:492] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:01.433720 24261 ts_tablet_manager.cc:1397] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.102s user 0.001s sys 0.013s
I20260807 11:09:01.436415 24261 raft_consensus.cc:348] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.435586 24262 tablet_bootstrap.cc:492] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:09:01.441578 23745 leader_election.cc:341] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:01.441979 23745 leader_election.cc:302] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
W20260807 11:09:01.448804 23510 consensus_peers.cc:487] T f36b812880814298990c9aee6999f113 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:01.455214 24261 raft_consensus.cc:374] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.457130 24261 raft_consensus.cc:729] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.459059 25196 raft_consensus.cc:2726] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:01.457877 24261 consensus_queue.cc:260] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.461700 24266 consensus_queue.cc:260] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.467736 23614 raft_consensus.cc:2454] T 5fb920ddfaaa423387c98112b52fc2e7 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:09:01.478050 23954 leader_election.cc:302] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.479286 25166 raft_consensus.cc:2781] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:01.479744 25166 raft_consensus.cc:686] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
I20260807 11:09:01.479935 24261 ts_tablet_manager.cc:1428] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.046s user 0.001s sys 0.005s
I20260807 11:09:01.480523 25166 consensus_queue.cc:237] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.486959 24266 ts_tablet_manager.cc:1428] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.077s user 0.005s sys 0.004s
I20260807 11:09:01.491293 24266 tablet_bootstrap.cc:492] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:01.497916 24262 tablet_bootstrap.cc:654] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:01.504385 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 62841us
W20260807 11:09:01.505877 23745 leader_election.cc:341] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:01.513332 24261 tablet_bootstrap.cc:492] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:01.518509 24261 tablet_bootstrap.cc:654] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.531646 24266 tablet_bootstrap.cc:654] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.565688 25166 raft_consensus.cc:482] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.566188 25166 raft_consensus.cc:504] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:01.568089 25166 leader_election.cc:288] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:01.572399 23954 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: d5260c798aa645e5becf393f06528f87
W20260807 11:09:01.573323 23951 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: d5260c798aa645e5becf393f06528f87
I20260807 11:09:01.573650 23951 leader_election.cc:302] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.574573 25166 raft_consensus.cc:2726] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:01.592800 24982 raft_consensus.cc:482] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.593279 24982 raft_consensus.cc:504] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.595240 24982 leader_election.cc:288] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.595995 24262 tablet_bootstrap.cc:492] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:01.597324 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:01.597527 24262 ts_tablet_manager.cc:1397] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.165s user 0.014s sys 0.003s
I20260807 11:09:01.599673 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:01.601552 23510 leader_election.cc:341] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:01.597967 23837 raft_consensus.cc:2454] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:01.603147 23507 leader_election.cc:302] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:01.604594 24982 raft_consensus.cc:2781] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:01.604912 24982 raft_consensus.cc:482] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:01.605204 24982 raft_consensus.cc:3037] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.625263 24982 raft_consensus.cc:504] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.635140 24262 raft_consensus.cc:348] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.645385 24266 tablet_bootstrap.cc:492] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:01.644595 24262 raft_consensus.cc:374] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.645852 24266 ts_tablet_manager.cc:1397] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.155s user 0.007s sys 0.005s
I20260807 11:09:01.646291 24262 raft_consensus.cc:729] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.649056 24266 raft_consensus.cc:348] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.649770 24266 raft_consensus.cc:374] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.651010 24266 raft_consensus.cc:729] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.651887 24266 consensus_queue.cc:260] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.632164 24261 tablet_bootstrap.cc:492] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:01.652812 24262 consensus_queue.cc:260] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.656800 24261 ts_tablet_manager.cc:1397] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.144s user 0.012s sys 0.001s
I20260807 11:09:01.663672 24261 raft_consensus.cc:348] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.664700 24262 ts_tablet_manager.cc:1428] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.066s user 0.011s sys 0.000s
I20260807 11:09:01.665930 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:01.666579 23837 raft_consensus.cc:3037] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.672914 24262 tablet_bootstrap.cc:492] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:01.677523 23837 raft_consensus.cc:2454] T cef5bc28dada49bdada085e87d1f0dab P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:01.661801 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:01.668576 25166 raft_consensus.cc:482] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.694609 25166 raft_consensus.cc:504] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.699585 25166 leader_election.cc:288] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:01.682216 23510 consensus_peers.cc:487] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:01.700093 23951 leader_election.cc:341] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: d78ed82613064935919934df7124d707
W20260807 11:09:01.701200 23510 leader_election.cc:341] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:01.701320 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d78ed82613064935919934df7124d707" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:01.702107 23614 raft_consensus.cc:2454] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
I20260807 11:09:01.705842 23954 leader_election.cc:302] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.706738 24844 consensus_queue.cc:1035] T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:01.692437 24982 leader_election.cc:288] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.713578 24261 raft_consensus.cc:374] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:01.720903 24846 raft_consensus.cc:2781] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:01.721369 24846 raft_consensus.cc:482] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:01.721768 24846 raft_consensus.cc:3037] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.737486 24266 ts_tablet_manager.cc:1428] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.091s user 0.001s sys 0.005s
I20260807 11:09:01.739941 24261 raft_consensus.cc:729] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:01.742708 23507 leader_election.cc:302] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:01.744449 24844 raft_consensus.cc:2781] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:01.746814 24844 raft_consensus.cc:686] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:01.747864 24844 consensus_queue.cc:237] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:01.744064 24945 mvcc.cc:205] Tried to move back new op lower bound from 7315869424253140992 to 7315869378776371200. Current Snapshot: MvccSnapshot[applied={T|T < 7315869424253140992 or (T in {7315869424253140992})}]
I20260807 11:09:01.773608 24262 tablet_bootstrap.cc:654] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.781147 24261 consensus_queue.cc:260] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:01.813107 24561 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.591s (SENT)
W20260807 11:09:01.818585 23027 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 52473.1us
I20260807 11:09:01.739974 24055 raft_consensus.cc:3037] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.828950 25234 raft_consensus.cc:482] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:01.831967 25234 raft_consensus.cc:504] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.729970 24846 raft_consensus.cc:504] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:01.839597 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:01.840934 23951 leader_election.cc:341] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: d78ed82613064935919934df7124d707
I20260807 11:09:01.841557 24846 leader_election.cc:288] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.841840 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d78ed82613064935919934df7124d707" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:01.842414 23614 raft_consensus.cc:3037] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.847225 24057 raft_consensus.cc:3037] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.868216 24058 raft_consensus.cc:3037] T 1ce42b3bd73242418f510c5b83259238 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.869850 23614 raft_consensus.cc:2454] T d78ed82613064935919934df7124d707 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:09:01.877264 23954 leader_election.cc:302] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters: 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.894140 24262 tablet_bootstrap.cc:492] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:01.900085 25230 raft_consensus.cc:2781] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:01.905592 24266 tablet_bootstrap.cc:492] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:01.906723 25234 leader_election.cc:288] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.909243 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a5e42d83ac4becb19a55d21040a3cc" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:01.911329 23951 leader_election.cc:302] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.854733 24261 ts_tablet_manager.cc:1428] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.198s user 0.006s sys 0.000s
I20260807 11:09:01.904402 24262 ts_tablet_manager.cc:1397] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.232s user 0.013s sys 0.017s
I20260807 11:09:01.913517 24261 tablet_bootstrap.cc:492] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:01.966904 24852 consensus_queue.cc:1035] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:01.939208 25234 raft_consensus.cc:2726] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:01.969292 25166 raft_consensus.cc:482] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a668588fabb4a9eba107cd6020f1e93)
I20260807 11:09:01.969782 25166 raft_consensus.cc:504] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:09:01.973178 23510 consensus_peers.cc:487] T 2013df97d54d43aaa844154c200a5a4f P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:01.974973 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:01.979235 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc48c13644a3401ab34dad398a7f5cd5" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:01.986869 24266 tablet_bootstrap.cc:654] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:01.983511 23954 leader_election.cc:302] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:01.996294 25241 raft_consensus.cc:2726] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:01.996492 24055 raft_consensus.cc:3037] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:01.981387 25166 leader_election.cc:288] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:01.966365 25230 raft_consensus.cc:686] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
I20260807 11:09:02.014473 24852 raft_consensus.cc:482] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.015009 24852 raft_consensus.cc:504] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.015271 25230 consensus_queue.cc:237] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:02.019435 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:02.021248 23510 leader_election.cc:341] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.023118 24852 leader_election.cc:288] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:02.023551 24262 raft_consensus.cc:348] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.023880 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:02.052363 24262 raft_consensus.cc:374] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.059988 23837 raft_consensus.cc:2454] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:02.060181 24262 raft_consensus.cc:729] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.083280 23507 leader_election.cc:302] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:02.084254 24852 raft_consensus.cc:2781] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:02.084565 24852 raft_consensus.cc:482] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:02.084822 24852 raft_consensus.cc:3037] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.085325 24262 consensus_queue.cc:260] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.098140 25139 raft_consensus.cc:482] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.098578 25139 raft_consensus.cc:504] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:02.106019 25139 leader_election.cc:288] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:02.092335 24852 raft_consensus.cc:504] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.115717 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:02.116294 23846 raft_consensus.cc:3037] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.123147 25139 raft_consensus.cc:482] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.123809 25139 raft_consensus.cc:504] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.126874 24852 leader_election.cc:288] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:02.128111 25139 leader_election.cc:288] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:02.132383 24262 ts_tablet_manager.cc:1428] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.217s user 0.017s sys 0.007s
W20260807 11:09:02.152341 23027 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet aea90f7a10234f2da4fff089afe87a1e (table default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet aea90f7a10234f2da4fff089afe87a1e consensus state has no leader
I20260807 11:09:02.153303 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:02.156457 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2108b1d026bb42a88f95fef8badb1d77" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:02.158175 23745 leader_election.cc:341] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:02.160701 23745 leader_election.cc:341] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.157665 24262 tablet_bootstrap.cc:492] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:02.229590 24844 raft_consensus.cc:482] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.230329 24844 raft_consensus.cc:504] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.233347 24844 leader_election.cc:288] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:02.234104 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:02.234771 23837 raft_consensus.cc:2454] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:02.235807 23507 leader_election.cc:302] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:02.236573 24844 raft_consensus.cc:2781] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:02.236922 24844 raft_consensus.cc:482] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:02.237246 24844 raft_consensus.cc:3037] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.254240 23846 raft_consensus.cc:2454] T cf445e8bf20b46f0831e218bb8eb3397 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:02.255038 25252 raft_consensus.cc:482] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.255682 25252 raft_consensus.cc:504] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:02.266523 25251 log.cc:924] Time spent T 5f41042d50184ecf9bbd2c225c86aabf P 8a668588fabb4a9eba107cd6020f1e93: Append to log took a long time: real 0.118s user 0.000s sys 0.000s
I20260807 11:09:02.285595 25139 raft_consensus.cc:482] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.286049 25139 raft_consensus.cc:504] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.287940 25139 leader_election.cc:288] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:02.288597 25253 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:02.289057 25253 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:02.291940 25253 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:09:02.292021 24675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:09:02.294909 23507 leader_election.cc:302] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:02.295696 24852 raft_consensus.cc:2781] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:02.296450 24852 raft_consensus.cc:686] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:02.297261 24852 consensus_queue.cc:237] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.299366 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:02.309434 24041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:02.311784 24040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:02.313995 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:02.316638 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:02.318475 23510 leader_election.cc:341] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.321708 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:02.319482 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2108b1d026bb42a88f95fef8badb1d77" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:02.333766 23510 leader_election.cc:341] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:02.336441 23510 consensus_peers.cc:487] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:02.338831 24266 tablet_bootstrap.cc:492] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:02.339285 24266 ts_tablet_manager.cc:1397] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.434s user 0.041s sys 0.035s
I20260807 11:09:02.341539 24266 raft_consensus.cc:348] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:02.342324 24266 raft_consensus.cc:374] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.342617 24266 raft_consensus.cc:729] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.343324 24266 consensus_queue.cc:260] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:09:02.343912 23745 leader_election.cc:341] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.344724 25139 raft_consensus.cc:482] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.345115 25139 raft_consensus.cc:504] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.345548 24266 ts_tablet_manager.cc:1428] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 11:09:02.346426 24266 tablet_bootstrap.cc:492] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:02.346995 25139 leader_election.cc:288] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:02.348225 23745 leader_election.cc:341] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:02.348855 23745 leader_election.cc:341] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.349287 23745 leader_election.cc:302] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:02.356323 25184 consensus_queue.cc:1035] T cc365534189d493a9f3d28bbd4214544 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:02.359543 24266 tablet_bootstrap.cc:654] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.388350 24266 tablet_bootstrap.cc:492] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:02.388749 24266 ts_tablet_manager.cc:1397] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.000s
I20260807 11:09:02.391103 24266 raft_consensus.cc:348] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.391788 24266 raft_consensus.cc:374] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.391984 24261 tablet_bootstrap.cc:654] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.392118 24266 raft_consensus.cc:729] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.392737 24266 consensus_queue.cc:260] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.394886 24266 ts_tablet_manager.cc:1428] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260807 11:09:02.395661 24266 tablet_bootstrap.cc:492] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:02.400451 24266 tablet_bootstrap.cc:654] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.402611 24043 raft_consensus.cc:3037] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.435055 24844 raft_consensus.cc:504] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.336616 24262 tablet_bootstrap.cc:654] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.436216 25139 raft_consensus.cc:2726] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:02.437110 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 88274.9us
W20260807 11:09:02.437808 23745 leader_election.cc:341] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.437966 24266 tablet_bootstrap.cc:492] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:02.438361 24266 ts_tablet_manager.cc:1397] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.011s
I20260807 11:09:02.438297 23745 leader_election.cc:302] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:02.412333 25252 leader_election.cc:288] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:02.438791 24561 leader_election.cc:334] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.591s (SENT)
I20260807 11:09:02.439277 24561 leader_election.cc:302] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b43b3e5203ee4ac3a23fa1902356994b; no voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822
I20260807 11:09:02.452432 24266 raft_consensus.cc:348] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.454627 24266 raft_consensus.cc:374] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.455825 24266 raft_consensus.cc:729] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.457026 24266 consensus_queue.cc:260] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.460443 25266 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:02.462471 24266 ts_tablet_manager.cc:1428] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.024s user 0.003s sys 0.003s
I20260807 11:09:02.463359 24266 tablet_bootstrap.cc:492] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:02.488548 24266 tablet_bootstrap.cc:654] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.490206 25139 raft_consensus.cc:2726] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:02.495675 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 57886.6us
I20260807 11:09:02.456718 24982 raft_consensus.cc:482] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.496642 24982 raft_consensus.cc:504] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.498601 24982 leader_election.cc:288] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:02.502148 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a7ccf34faf345998028f67921927f0e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:02.503894 23510 leader_election.cc:341] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.516577 24261 tablet_bootstrap.cc:492] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:02.505189 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a7ccf34faf345998028f67921927f0e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:02.518752 24262 tablet_bootstrap.cc:492] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:02.519708 24262 ts_tablet_manager.cc:1397] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.368s user 0.017s sys 0.016s
I20260807 11:09:02.519676 23846 raft_consensus.cc:2454] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:02.522047 24262 raft_consensus.cc:348] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.522701 24262 raft_consensus.cc:374] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 11:09:02.543282 23745 leader_election.cc:341] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.543824 23745 leader_election.cc:302] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:02.544545 25252 raft_consensus.cc:2726] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:02.524307 24262 raft_consensus.cc:729] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.551362 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:02.520881 23507 leader_election.cc:302] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
W20260807 11:09:02.552814 23510 leader_election.cc:341] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.555351 25268 raft_consensus.cc:2781] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:02.563264 24261 ts_tablet_manager.cc:1397] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.650s user 0.012s sys 0.000s
I20260807 11:09:02.565635 24261 raft_consensus.cc:348] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.566404 24261 raft_consensus.cc:374] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.555778 25268 raft_consensus.cc:482] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:02.567093 25268 raft_consensus.cc:3037] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.576972 24262 consensus_queue.cc:260] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.579156 24262 ts_tablet_manager.cc:1428] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.059s user 0.004s sys 0.006s
I20260807 11:09:02.579269 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:02.580044 24262 tablet_bootstrap.cc:492] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:02.580205 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:02.584414 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:02.585203 23846 raft_consensus.cc:3037] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.586930 24266 tablet_bootstrap.cc:492] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:02.587337 24266 ts_tablet_manager.cc:1397] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.124s user 0.030s sys 0.009s
I20260807 11:09:02.590528 24266 raft_consensus.cc:348] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.590988 24844 leader_election.cc:288] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:02.591184 24266 raft_consensus.cc:374] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.591481 24266 raft_consensus.cc:729] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.592125 24266 consensus_queue.cc:260] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.594457 24266 ts_tablet_manager.cc:1428] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 11:09:02.600281 24266 tablet_bootstrap.cc:492] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:02.606498 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:02.613857 24266 tablet_bootstrap.cc:654] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.618676 25230 consensus_queue.cc:1035] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:02.652128 24266 tablet_bootstrap.cc:492] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:02.652592 24266 ts_tablet_manager.cc:1397] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.010s
I20260807 11:09:02.652197 24261 raft_consensus.cc:729] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.656265 24266 raft_consensus.cc:348] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.662766 24266 raft_consensus.cc:374] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.663118 24266 raft_consensus.cc:729] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.663738 24266 consensus_queue.cc:260] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.671130 24266 ts_tablet_manager.cc:1428] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260807 11:09:02.676455 24261 consensus_queue.cc:260] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.678578 24261 ts_tablet_manager.cc:1428] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.115s user 0.005s sys 0.000s
W20260807 11:09:02.666932 23745 leader_election.cc:341] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.673713 24043 raft_consensus.cc:3037] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.681864 24266 tablet_bootstrap.cc:492] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:02.690260 24266 tablet_bootstrap.cc:654] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.715216 25139 raft_consensus.cc:482] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.715919 25139 raft_consensus.cc:504] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:02.718569 25139 leader_election.cc:288] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:09:02.723604 23745 leader_election.cc:341] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.724082 23745 leader_election.cc:302] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:02.724828 25252 raft_consensus.cc:2726] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:02.742594 23954 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 124304us
W20260807 11:09:02.749359 23951 consensus_peers.cc:487] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fb920ddfaaa423387c98112b52fc2e7. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:02.752535 24266 tablet_bootstrap.cc:492] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:02.752931 24266 ts_tablet_manager.cc:1397] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.071s user 0.010s sys 0.003s
I20260807 11:09:02.755475 24266 raft_consensus.cc:348] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.756140 24266 raft_consensus.cc:374] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.756381 24266 raft_consensus.cc:729] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.767102 24266 consensus_queue.cc:260] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.780992 24266 ts_tablet_manager.cc:1428] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.028s user 0.005s sys 0.003s
I20260807 11:09:02.787161 25185 consensus_queue.cc:1035] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:02.790495 25252 raft_consensus.cc:482] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.790998 24266 tablet_bootstrap.cc:492] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:02.791055 25252 raft_consensus.cc:504] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.782996 24262 tablet_bootstrap.cc:654] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.793824 25252 leader_election.cc:288] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:02.800633 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 77057.8us
W20260807 11:09:02.803246 23745 leader_election.cc:341] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:02.806330 23745 leader_election.cc:302] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:02.807371 24261 tablet_bootstrap.cc:492] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:02.808495 24266 tablet_bootstrap.cc:654] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:02.810935 25139 raft_consensus.cc:2726] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:02.803627 25252 consensus_queue.cc:1035] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 11:09:02.826408 24043 raft_consensus.cc:3037] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:02.836622 23745 consensus_peers.cc:487] T 573b681662bc409aa36ccc65e14e9841 P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:02.851212 25240 raft_consensus.cc:482] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.851688 25240 raft_consensus.cc:504] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.854012 25240 leader_election.cc:288] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:02.865211 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:02.885413 25240 raft_consensus.cc:482] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.886113 25240 raft_consensus.cc:504] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.888505 25240 leader_election.cc:288] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:02.891247 23954 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 5eaf45dad4a944dab77330db6fc53222
W20260807 11:09:02.893275 23951 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5eaf45dad4a944dab77330db6fc53222
I20260807 11:09:02.893644 23951 leader_election.cc:302] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:02.896656 25240 raft_consensus.cc:2726] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:02.902199 24058 raft_consensus.cc:3037] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:02.929684 25240 consensus_queue.cc:1035] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:02.925882 25283 consensus_queue.cc:1035] T cef5bc28dada49bdada085e87d1f0dab P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260807 11:09:02.944344 24266 tablet_bootstrap.cc:492] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:02.944763 24266 ts_tablet_manager.cc:1397] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.154s user 0.008s sys 0.004s
I20260807 11:09:02.949683 24266 raft_consensus.cc:348] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.950331 24266 raft_consensus.cc:374] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:02.950554 24266 raft_consensus.cc:729] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:02.951138 24266 consensus_queue.cc:260] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.953374 25184 raft_consensus.cc:482] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:02.954052 24266 ts_tablet_manager.cc:1428] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 11:09:02.953923 25184 raft_consensus.cc:504] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:02.730448 25268 raft_consensus.cc:504] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:02.969596 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 46495.6us
I20260807 11:09:02.971879 24266 tablet_bootstrap.cc:492] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:09:02.976089 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 106429us
I20260807 11:09:02.985864 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:02.988991 23510 leader_election.cc:341] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.018236 25184 leader_election.cc:288] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:03.031538 23951 consensus_peers.cc:487] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d78ed82613064935919934df7124d707. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:03.043103 24266 tablet_bootstrap.cc:654] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:03.044226 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a7ccf34faf345998028f67921927f0e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:03.041698 25268 leader_election.cc:288] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:03.045959 23510 leader_election.cc:341] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.087678 25290 raft_consensus.cc:482] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.088239 25290 raft_consensus.cc:504] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.100768 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.090780 25290 leader_election.cc:288] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:02.855790 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef5bc28dada49bdada085e87d1f0dab" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:03.164388 23951 leader_election.cc:302] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:03.164717 25139 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.005748 23846 raft_consensus.cc:2454] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:03.082264 24262 tablet_bootstrap.cc:492] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:03.165396 24262 ts_tablet_manager.cc:1397] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.586s user 0.025s sys 0.019s
I20260807 11:09:03.165129 25139 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.092165 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "912026edd2664386880028a5958a993c" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:03.102993 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:03.167765 23841 raft_consensus.cc:2454] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:03.167625 24262 raft_consensus.cc:348] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:03.168254 24262 raft_consensus.cc:374] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.168479 24262 raft_consensus.cc:729] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:03.168853 25139 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:03.105930 25252 raft_consensus.cc:482] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.169013 24262 consensus_queue.cc:260] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:03.169691 25252 raft_consensus.cc:504] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.171639 24262 ts_tablet_manager.cc:1428] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 11:09:03.171631 25252 leader_election.cc:288] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:03.126993 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a7ccf34faf345998028f67921927f0e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:03.172727 24262 tablet_bootstrap.cc:492] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:03.172803 23844 raft_consensus.cc:3037] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:03.179250 23844 raft_consensus.cc:2454] T 7a7ccf34faf345998028f67921927f0e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:03.182832 23507 leader_election.cc:302] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:03.187063 25185 raft_consensus.cc:2781] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:03.187494 25185 raft_consensus.cc:482] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:03.187894 25185 raft_consensus.cc:3037] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:03.192831 23507 leader_election.cc:302] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:03.193665 24982 raft_consensus.cc:2781] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:03.194247 24982 raft_consensus.cc:686] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:03.195843 24982 consensus_queue.cc:237] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.204615 24266 tablet_bootstrap.cc:492] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:03.205027 24266 ts_tablet_manager.cc:1397] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.250s user 0.015s sys 0.015s
W20260807 11:09:03.214403 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 402334us
I20260807 11:09:03.219414 23507 leader_election.cc:302] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:03.220237 25184 raft_consensus.cc:2781] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:03.220680 25184 raft_consensus.cc:686] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:03.221527 25184 consensus_queue.cc:237] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:03.223935 23951 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 59632.2us
I20260807 11:09:03.224787 23951 leader_election.cc:302] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:03.225454 24266 raft_consensus.cc:348] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.225805 25270 raft_consensus.cc:2726] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.226133 24266 raft_consensus.cc:374] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.226392 24266 raft_consensus.cc:729] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:03.226416 25270 raft_consensus.cc:2726] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.227097 24266 consensus_queue.cc:260] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.229259 24266 ts_tablet_manager.cc:1428] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260807 11:09:03.230182 24266 tablet_bootstrap.cc:492] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:03.233624 24043 raft_consensus.cc:3037] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:03.240687 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:03.241966 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:03.243875 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.245002 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.254650 25185 raft_consensus.cc:504] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.258054 24261 tablet_bootstrap.cc:654] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:03.262378 25185 leader_election.cc:288] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:03.265130 23614 raft_consensus.cc:2379] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99a8d4e2c1b14150b03ad0f28e74a011 in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:03.265197 25230 raft_consensus.cc:482] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.265663 25230 raft_consensus.cc:504] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.268708 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:03.277859 24262 tablet_bootstrap.cc:654] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:03.279975 25230 leader_election.cc:288] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:03.289896 24266 tablet_bootstrap.cc:654] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:03.291177 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:03.298410 25230 raft_consensus.cc:482] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.299118 25230 raft_consensus.cc:504] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.301990 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573b681662bc409aa36ccc65e14e9841" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.302991 23614 raft_consensus.cc:2379] T 573b681662bc409aa36ccc65e14e9841 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in this term.
I20260807 11:09:03.305380 23608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.306825 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907f602c4dce41389e06307270c16f71" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.309437 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907f602c4dce41389e06307270c16f71" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:03.312136 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:03.314455 24266 tablet_bootstrap.cc:492] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:03.314834 24266 ts_tablet_manager.cc:1397] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.085s user 0.005s sys 0.006s
W20260807 11:09:03.318045 23510 leader_election.cc:341] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.319221 23954 leader_election.cc:302] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:03.320089 25290 raft_consensus.cc:3037] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:03.331923 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:03.332643 23844 raft_consensus.cc:3037] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:03.353245 25290 raft_consensus.cc:2726] T 573b681662bc409aa36ccc65e14e9841 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.368880 25230 leader_election.cc:288] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:03.372424 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:03.376055 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc365534189d493a9f3d28bbd4214544" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.338688 23844 raft_consensus.cc:2454] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:03.318388 24266 raft_consensus.cc:348] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.377796 24266 raft_consensus.cc:374] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.378121 24266 raft_consensus.cc:729] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
W20260807 11:09:03.379926 23745 leader_election.cc:341] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.378679 24266 consensus_queue.cc:260] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.380541 23954 leader_election.cc:302] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:03.381774 24266 ts_tablet_manager.cc:1428] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.067s user 0.005s sys 0.000s
I20260807 11:09:03.382303 25240 raft_consensus.cc:2726] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.389859 23507 leader_election.cc:302] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:03.394618 25304 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:03.395326 25304 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:03.398671 25139 raft_consensus.cc:482] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.399209 25139 raft_consensus.cc:504] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:03.401096 23745 leader_election.cc:341] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.401185 25139 leader_election.cc:288] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:09:03.401675 23745 leader_election.cc:341] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:03.402400 23745 leader_election.cc:341] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:03.435560 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 45779.3us
I20260807 11:09:03.402714 23745 leader_election.cc:302] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:03.444751 25139 raft_consensus.cc:2726] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.394515 24261 tablet_bootstrap.cc:492] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:03.451555 24261 ts_tablet_manager.cc:1397] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.644s user 0.003s sys 0.011s
I20260807 11:09:03.462834 24261 raft_consensus.cc:348] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.463531 24261 raft_consensus.cc:374] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.463779 24261 raft_consensus.cc:729] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:03.464313 24261 consensus_queue.cc:260] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.390491 25268 consensus_queue.cc:1035] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 11:09:03.473043 23510 consensus_peers.cc:487] T cf445e8bf20b46f0831e218bb8eb3397 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:03.473372 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 66342.9us
I20260807 11:09:03.485862 23187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:09:03.436144 25184 raft_consensus.cc:2781] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:03.488684 25184 raft_consensus.cc:686] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:03.489848 25184 consensus_queue.cc:237] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.500626 24266 tablet_bootstrap.cc:492] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:09:03.507711 23745 leader_election.cc:341] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.510344 24261 ts_tablet_manager.cc:1428] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.058s user 0.007s sys 0.000s
I20260807 11:09:03.524056 24266 tablet_bootstrap.cc:654] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:03.498041 25304 leader_election.cc:288] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309)
I20260807 11:09:03.508744 23745 leader_election.cc:302] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:03.527824 24261 tablet_bootstrap.cc:492] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:09:03.541427 23745 leader_election.cc:341] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.557132 24266 tablet_bootstrap.cc:492] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:03.557597 24266 ts_tablet_manager.cc:1397] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.001s
I20260807 11:09:03.559983 24266 raft_consensus.cc:348] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:03.550196 25139 raft_consensus.cc:2726] T a20f0ba778a14d71b9e5efa113c784ff P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.576337 23745 leader_election.cc:302] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:03.576977 25139 raft_consensus.cc:2726] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:03.577325 23745 leader_election.cc:341] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.577678 23745 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:03.578267 25139 raft_consensus.cc:2726] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.575882 24262 tablet_bootstrap.cc:492] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:03.579176 24262 ts_tablet_manager.cc:1397] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.407s user 0.011s sys 0.008s
I20260807 11:09:03.572021 24043 raft_consensus.cc:3037] T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:03.628166 24266 raft_consensus.cc:374] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.628671 24266 raft_consensus.cc:729] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:03.584262 24262 raft_consensus.cc:348] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.638159 24262 raft_consensus.cc:374] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.638562 24262 raft_consensus.cc:729] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:03.644138 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.644601 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:03.648855 23142 leader_election.cc:334] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.626s (SENT)
I20260807 11:09:03.649257 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:03.640426 24262 consensus_queue.cc:260] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.678138 24261 tablet_bootstrap.cc:654] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:03.687717 25322 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:03.632205 24266 consensus_queue.cc:260] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:09:03.695479 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 46659.8us
W20260807 11:09:03.695194 23745 leader_election.cc:341] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.723306 25139 raft_consensus.cc:482] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.723941 25139 raft_consensus.cc:504] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:03.726563 25139 leader_election.cc:288] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:09:03.755770 23745 leader_election.cc:341] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.761509 24266 ts_tablet_manager.cc:1428] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.203s user 0.010s sys 0.001s
I20260807 11:09:03.765486 24266 tablet_bootstrap.cc:492] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:09:03.767613 25320 log.cc:924] Time spent T cc365534189d493a9f3d28bbd4214544 P c281254655c84a0496c50045c37b22df: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260807 11:09:03.783970 24262 ts_tablet_manager.cc:1428] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.204s user 0.012s sys 0.000s
I20260807 11:09:03.807677 24262 tablet_bootstrap.cc:492] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:03.757274 23745 leader_election.cc:302] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:03.813702 25139 raft_consensus.cc:2726] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.820165 25139 raft_consensus.cc:482] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.820573 25139 raft_consensus.cc:504] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.822402 25139 leader_election.cc:288] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:03.841082 25240 raft_consensus.cc:482] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.841575 25240 raft_consensus.cc:504] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.844400 25290 raft_consensus.cc:482] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:03.845355 24266 tablet_bootstrap.cc:654] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:03.849084 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 93323.9us
I20260807 11:09:03.844811 25290 raft_consensus.cc:504] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.855587 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:03.856756 25240 leader_election.cc:288] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:03.858316 25290 leader_election.cc:288] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:03.860301 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:09:03.861616 23951 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 8a2df15b35bd435baaf95a708ec85a37
I20260807 11:09:03.865041 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc36c0c8fded4ac6991b98c132b17e56" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:03.877719 23954 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 8a2df15b35bd435baaf95a708ec85a37
I20260807 11:09:03.878125 23954 leader_election.cc:302] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:03.891232 25290 raft_consensus.cc:2726] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.894626 23954 leader_election.cc:302] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:03.894752 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:03.895656 25230 raft_consensus.cc:2726] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.896445 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:03.900539 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:03.926774 23745 leader_election.cc:341] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:03.927415 23745 leader_election.cc:341] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:03.928253 23745 leader_election.cc:341] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.928570 23745 leader_election.cc:302] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:03.929203 25139 raft_consensus.cc:2726] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:03.929471 23745 leader_election.cc:341] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:03.929816 23745 leader_election.cc:302] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:03.930425 25139 raft_consensus.cc:2726] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:03.958278 24266 tablet_bootstrap.cc:492] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:03.958772 24266 ts_tablet_manager.cc:1397] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.194s user 0.005s sys 0.012s
I20260807 11:09:03.961786 24266 raft_consensus.cc:348] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.962466 24266 raft_consensus.cc:374] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.962800 24266 raft_consensus.cc:729] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:03.963481 24266 consensus_queue.cc:260] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.980373 24261 tablet_bootstrap.cc:492] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:03.980820 24261 ts_tablet_manager.cc:1397] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.453s user 0.010s sys 0.011s
I20260807 11:09:03.985044 24262 tablet_bootstrap.cc:654] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:03.986157 24261 raft_consensus.cc:348] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.986822 24261 raft_consensus.cc:374] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:03.987093 24261 raft_consensus.cc:729] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:03.987632 24261 consensus_queue.cc:260] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:03.989430 24261 ts_tablet_manager.cc:1428] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260807 11:09:04.002702 24266 ts_tablet_manager.cc:1428] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260807 11:09:04.008158 24266 tablet_bootstrap.cc:492] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:04.039125 24262 tablet_bootstrap.cc:492] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:04.039618 24262 ts_tablet_manager.cc:1397] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.232s user 0.008s sys 0.009s
I20260807 11:09:04.041365 25240 raft_consensus.cc:482] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.041772 25240 raft_consensus.cc:504] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.042061 24262 raft_consensus.cc:348] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.042682 24262 raft_consensus.cc:374] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.042937 24262 raft_consensus.cc:729] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.043649 25240 leader_election.cc:288] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.043463 24262 consensus_queue.cc:260] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.045851 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:04.046543 23844 raft_consensus.cc:2379] T 0d81cc2870864a30a62a20921273d55d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:04.060783 24266 tablet_bootstrap.cc:654] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.072585 24262 ts_tablet_manager.cc:1428] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260807 11:09:04.075001 25240 raft_consensus.cc:482] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.075440 25240 raft_consensus.cc:504] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:04.077263 25240 leader_election.cc:288] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.079770 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:04.080363 23844 raft_consensus.cc:2454] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
I20260807 11:09:04.081503 23951 leader_election.cc:302] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:09:04.084736 24262 tablet_bootstrap.cc:492] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:04.087100 25240 raft_consensus.cc:2781] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:04.087409 25240 raft_consensus.cc:482] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:04.087694 25240 raft_consensus.cc:3037] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.089596 24262 tablet_bootstrap.cc:654] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.117434 24262 tablet_bootstrap.cc:492] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:04.117843 24262 ts_tablet_manager.cc:1397] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.005s
I20260807 11:09:04.120054 24262 raft_consensus.cc:348] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.120719 24262 raft_consensus.cc:374] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.120968 24262 raft_consensus.cc:729] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.121526 24262 consensus_queue.cc:260] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.139230 24262 ts_tablet_manager.cc:1428] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
I20260807 11:09:04.155771 24261 tablet_bootstrap.cc:492] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:04.161448 24982 raft_consensus.cc:482] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.163209 25323 raft_consensus.cc:482] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.162355 24982 raft_consensus.cc:504] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.163672 25323 raft_consensus.cc:504] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.165795 25323 leader_election.cc:288] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.166296 24982 leader_election.cc:288] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.168140 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:04.168717 23844 raft_consensus.cc:2454] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
I20260807 11:09:04.169906 23951 leader_election.cc:302] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:09:04.170589 25323 raft_consensus.cc:2781] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:04.170925 25323 raft_consensus.cc:482] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:04.171217 25323 raft_consensus.cc:3037] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.180127 25323 raft_consensus.cc:504] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.196090 24266 tablet_bootstrap.cc:492] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:04.196669 24266 ts_tablet_manager.cc:1397] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.189s user 0.010s sys 0.000s
I20260807 11:09:04.199896 24266 raft_consensus.cc:348] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.200803 24266 raft_consensus.cc:374] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.204666 24261 tablet_bootstrap.cc:654] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.207688 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:04.208189 23844 raft_consensus.cc:3037] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.209578 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:04.210253 23846 raft_consensus.cc:2454] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:04.218539 23507 leader_election.cc:302] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:04.219542 25268 raft_consensus.cc:2781] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:04.219887 25268 raft_consensus.cc:482] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:04.220161 25268 raft_consensus.cc:3037] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.214749 23844 raft_consensus.cc:2454] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:09:04.221531 23951 leader_election.cc:302] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:09:04.222292 25230 raft_consensus.cc:2781] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:04.222710 25230 raft_consensus.cc:686] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
I20260807 11:09:04.223997 25230 consensus_queue.cc:237] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.115759 25240 raft_consensus.cc:504] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:04.230880 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:04.231385 23844 raft_consensus.cc:3037] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:04.235513 24561 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 101178us
I20260807 11:09:04.242416 24262 tablet_bootstrap.cc:492] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:04.230679 25268 raft_consensus.cc:504] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.252928 24262 tablet_bootstrap.cc:654] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.264199 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:04.269980 25240 leader_election.cc:288] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.274480 24054 raft_consensus.cc:3037] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.279312 24982 consensus_queue.cc:1035] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:04.201803 24266 raft_consensus.cc:729] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.206604 25323 leader_election.cc:288] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.282498 24266 consensus_queue.cc:260] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.286615 24982 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.287407 24982 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.289708 24982 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.292824 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d81cc2870864a30a62a20921273d55d" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:04.295531 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:04.298179 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:04.304858 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:04.306203 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:04.309719 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:04.312026 24048 raft_consensus.cc:3037] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.311990 25268 leader_election.cc:288] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.312382 23954 leader_election.cc:302] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
W20260807 11:09:04.313635 23954 leader_election.cc:341] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.315387 25230 raft_consensus.cc:482] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.315785 25230 raft_consensus.cc:504] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.317582 25230 leader_election.cc:288] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:04.318418 23954 leader_election.cc:341] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.319269 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:04.319900 23841 raft_consensus.cc:2454] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 0.
W20260807 11:09:04.320096 23954 leader_election.cc:341] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.320112 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:04.321107 23951 leader_election.cc:302] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters:
W20260807 11:09:04.321528 23954 leader_election.cc:341] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.322162 25230 raft_consensus.cc:2781] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:04.322485 25230 raft_consensus.cc:482] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 11:09:04.323418 23510 leader_election.cc:341] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.322769 25230 raft_consensus.cc:3037] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.331382 25323 raft_consensus.cc:2726] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:04.334906 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 49370.6us
W20260807 11:09:04.338749 23510 leader_election.cc:341] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.341295 24262 tablet_bootstrap.cc:492] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:04.341715 24262 ts_tablet_manager.cc:1397] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.099s user 0.011s sys 0.002s
W20260807 11:09:04.342491 23510 leader_election.cc:341] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.344935 24262 raft_consensus.cc:348] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:04.345575 24262 raft_consensus.cc:374] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.345821 24262 raft_consensus.cc:729] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.296752 23844 raft_consensus.cc:2454] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:09:04.352298 25339 consensus_queue.cc:1035] T 0d81cc2870864a30a62a20921273d55d P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:04.355201 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:04.355736 23840 raft_consensus.cc:3037] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.359560 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:04.360122 23841 raft_consensus.cc:2454] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:04.346397 24262 consensus_queue.cc:260] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:04.362025 24262 ts_tablet_manager.cc:1428] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.020s user 0.003s sys 0.003s
I20260807 11:09:04.362805 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:04.371042 23840 raft_consensus.cc:2454] T b3c9141f12804a96994994730996898b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:04.373152 23507 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:04.374431 25334 raft_consensus.cc:2781] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:04.374747 25334 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:04.375213 25334 raft_consensus.cc:3037] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.382259 24266 ts_tablet_manager.cc:1428] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.185s user 0.009s sys 0.000s
I20260807 11:09:04.388237 25334 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:04.391517 23954 leader_election.cc:341] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.391669 24262 tablet_bootstrap.cc:492] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:04.397358 25334 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.398360 23951 leader_election.cc:302] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93
I20260807 11:09:04.403034 25323 raft_consensus.cc:2781] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:04.403496 25323 raft_consensus.cc:686] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
I20260807 11:09:04.404258 25323 consensus_queue.cc:237] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:04.405674 25354 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:04.408896 24261 tablet_bootstrap.cc:492] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:04.409303 24261 ts_tablet_manager.cc:1397] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.254s user 0.008s sys 0.005s
I20260807 11:09:04.415496 23507 leader_election.cc:302] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:04.416016 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:04.416270 25184 raft_consensus.cc:2781] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:04.416728 25184 raft_consensus.cc:686] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:04.409523 25354 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:04.417608 25184 consensus_queue.cc:237] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:04.422677 23510 consensus_peers.cc:487] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:04.423302 23510 leader_election.cc:341] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.434269 24261 raft_consensus.cc:348] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.432792 25354 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:09:04.435618 24261 raft_consensus.cc:374] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.436203 24266 tablet_bootstrap.cc:492] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:04.443063 25346 raft_consensus.cc:482] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.443632 25346 raft_consensus.cc:504] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.447507 25346 leader_election.cc:288] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:04.448465 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:04.449467 23745 leader_election.cc:341] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.450431 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:04.451819 23745 leader_election.cc:341] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.452157 23745 leader_election.cc:302] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:04.453197 25346 raft_consensus.cc:2726] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:04.436269 24261 raft_consensus.cc:729] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.464955 24262 tablet_bootstrap.cc:654] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.470541 23841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:04.472383 23841 raft_consensus.cc:3037] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.463454 24261 consensus_queue.cc:260] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.475826 25184 consensus_queue.cc:1035] T 7a7ccf34faf345998028f67921927f0e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 11:09:04.483430 23030 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3733d4813197446e9ecc8be58f87eda7 consensus state has no leader
I20260807 11:09:04.497217 24261 ts_tablet_manager.cc:1428] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.087s user 0.010s sys 0.002s
I20260807 11:09:04.504670 24675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
W20260807 11:09:04.535185 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 57699us
I20260807 11:09:04.489199 25230 raft_consensus.cc:504] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.564507 24261 tablet_bootstrap.cc:492] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:04.579299 24266 tablet_bootstrap.cc:654] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.588431 23841 raft_consensus.cc:2454] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:04.589426 23507 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:04.599376 25230 leader_election.cc:288] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:04.601608 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:04.602169 23844 raft_consensus.cc:3037] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:04.608232 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
W20260807 11:09:04.611122 23954 leader_election.cc:341] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.611260 24261 tablet_bootstrap.cc:654] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.619910 24262 tablet_bootstrap.cc:492] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:04.620340 24262 ts_tablet_manager.cc:1397] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.229s user 0.004s sys 0.013s
I20260807 11:09:04.622505 24262 raft_consensus.cc:348] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.623138 24262 raft_consensus.cc:374] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.623395 24262 raft_consensus.cc:729] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.633556 23844 raft_consensus.cc:2454] T fb1504be4320471687d86a55a9891081 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:09:04.634716 23951 leader_election.cc:302] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93
I20260807 11:09:04.635514 25240 raft_consensus.cc:2781] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:04.636008 25240 raft_consensus.cc:686] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [term 1 LEADER]: Becoming Leader. State: Replica: c281254655c84a0496c50045c37b22df, State: Running, Role: LEADER
I20260807 11:09:04.636281 24262 consensus_queue.cc:260] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.636807 25240 consensus_queue.cc:237] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.638701 24262 ts_tablet_manager.cc:1428] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.018s user 0.002s sys 0.005s
I20260807 11:09:04.642475 24262 tablet_bootstrap.cc:492] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:04.647542 24262 tablet_bootstrap.cc:654] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.611984 25184 raft_consensus.cc:2781] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:04.676998 24262 tablet_bootstrap.cc:492] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:04.677546 24262 ts_tablet_manager.cc:1397] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.002s
I20260807 11:09:04.680209 24262 raft_consensus.cc:348] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.680850 24262 raft_consensus.cc:374] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.681070 24262 raft_consensus.cc:729] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.681618 24262 consensus_queue.cc:260] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.683542 24262 ts_tablet_manager.cc:1428] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 11:09:04.688634 24262 tablet_bootstrap.cc:492] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:04.693570 24262 tablet_bootstrap.cc:654] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.697549 25184 raft_consensus.cc:686] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:04.702270 25184 consensus_queue.cc:237] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.733827 25268 consensus_queue.cc:1035] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:04.739415 24261 tablet_bootstrap.cc:492] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:04.739832 24261 ts_tablet_manager.cc:1397] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.176s user 0.005s sys 0.005s
I20260807 11:09:04.741463 25230 raft_consensus.cc:482] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.741928 25230 raft_consensus.cc:504] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.743968 25230 leader_election.cc:288] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:04.746121 23954 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
W20260807 11:09:04.747623 23951 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
I20260807 11:09:04.747977 23951 leader_election.cc:302] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:04.759141 25290 raft_consensus.cc:2726] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:09:04.782449 23510 consensus_peers.cc:487] T a20f0ba778a14d71b9e5efa113c784ff P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:04.783442 24266 tablet_bootstrap.cc:492] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:04.783881 24266 ts_tablet_manager.cc:1397] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.348s user 0.008s sys 0.005s
I20260807 11:09:04.786101 24266 raft_consensus.cc:348] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.805361 24261 raft_consensus.cc:348] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:04.806079 24261 raft_consensus.cc:374] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.806344 24261 raft_consensus.cc:729] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.786741 24266 raft_consensus.cc:374] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.836913 24261 consensus_queue.cc:260] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:04.841291 24266 raft_consensus.cc:729] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.841997 24266 consensus_queue.cc:260] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.881590 24266 ts_tablet_manager.cc:1428] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.097s user 0.003s sys 0.003s
W20260807 11:09:04.887121 24561 leader_election.cc:334] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.649s (SENT)
I20260807 11:09:04.887624 24561 leader_election.cc:302] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b43b3e5203ee4ac3a23fa1902356994b; no voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822
I20260807 11:09:04.895201 24261 ts_tablet_manager.cc:1428] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.155s user 0.005s sys 0.002s
I20260807 11:09:04.896163 24261 tablet_bootstrap.cc:492] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:04.903584 25383 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:04.905165 24262 tablet_bootstrap.cc:492] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:04.905562 24262 ts_tablet_manager.cc:1397] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.217s user 0.035s sys 0.065s
I20260807 11:09:04.907828 24262 raft_consensus.cc:348] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.908428 24262 raft_consensus.cc:374] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.908648 24262 raft_consensus.cc:729] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.909209 24262 consensus_queue.cc:260] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.911372 24262 ts_tablet_manager.cc:1428] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 11:09:04.912328 24262 tablet_bootstrap.cc:492] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:04.915812 24261 tablet_bootstrap.cc:654] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.925578 24262 tablet_bootstrap.cc:654] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:04.929355 25139 raft_consensus.cc:482] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.929798 25139 raft_consensus.cc:504] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.931818 25139 leader_election.cc:288] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:04.933346 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:04.933466 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:04.934552 23745 leader_election.cc:341] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:04.935184 23745 leader_election.cc:341] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.935523 23745 leader_election.cc:302] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:04.936389 25139 raft_consensus.cc:2726] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:04.940201 25139 raft_consensus.cc:482] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:04.940708 25139 raft_consensus.cc:504] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:04.943171 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:04.943290 25139 leader_election.cc:288] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:09:04.944154 23745 leader_election.cc:341] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.945017 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:04.946105 23745 leader_election.cc:341] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:04.946436 23745 leader_election.cc:302] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:04.947154 24262 tablet_bootstrap.cc:492] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:04.947386 25139 raft_consensus.cc:2726] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:04.947645 24262 ts_tablet_manager.cc:1397] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.003s
I20260807 11:09:04.949928 24262 raft_consensus.cc:348] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.950587 24262 raft_consensus.cc:374] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:04.950841 24262 raft_consensus.cc:729] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:04.951423 24262 consensus_queue.cc:260] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:04.953423 24262 ts_tablet_manager.cc:1428] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 11:09:04.966125 24266 tablet_bootstrap.cc:492] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:04.995990 24262 tablet_bootstrap.cc:492] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:05.001114 24262 tablet_bootstrap.cc:654] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.015918 24262 tablet_bootstrap.cc:492] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:05.016314 24262 ts_tablet_manager.cc:1397] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.021s user 0.013s sys 0.000s
I20260807 11:09:05.018581 24262 raft_consensus.cc:348] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.019256 24262 raft_consensus.cc:374] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.019506 24262 raft_consensus.cc:729] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.020123 24262 consensus_queue.cc:260] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.022114 24262 ts_tablet_manager.cc:1428] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 11:09:05.025394 24262 tablet_bootstrap.cc:492] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:05.033288 24262 tablet_bootstrap.cc:654] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.040686 25139 raft_consensus.cc:482] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.041136 25139 raft_consensus.cc:504] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.043112 25139 leader_election.cc:288] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:05.046388 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:05.047952 24266 tablet_bootstrap.cc:654] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.047987 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:05.048664 25338 raft_consensus.cc:482] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:09:05.048776 23745 leader_election.cc:341] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.049407 25338 raft_consensus.cc:504] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.052218 25338 leader_election.cc:288] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.052861 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.053620 23840 raft_consensus.cc:2379] T 9c4f1adf1fb9450cba3de70397beaa2b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a668588fabb4a9eba107cd6020f1e93 in current term 1: Already voted for candidate c281254655c84a0496c50045c37b22df in this term.
I20260807 11:09:05.057231 24262 tablet_bootstrap.cc:492] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:05.057238 24261 tablet_bootstrap.cc:492] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:05.057819 24261 ts_tablet_manager.cc:1397] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.162s user 0.017s sys 0.017s
I20260807 11:09:05.058177 25139 raft_consensus.cc:482] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.058642 25139 raft_consensus.cc:504] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.060477 25139 leader_election.cc:288] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:05.061360 23745 leader_election.cc:341] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.061574 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c31c37cb2a4d1d8396a79de7d2493c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:05.061728 23745 leader_election.cc:302] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.062353 25139 raft_consensus.cc:2726] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.063429 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4f1adf1fb9450cba3de70397beaa2b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:05.062688 23745 leader_election.cc:341] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.064718 24261 raft_consensus.cc:348] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:05.066766 23510 leader_election.cc:302] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.067265 23614 raft_consensus.cc:3037] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.068892 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c31c37cb2a4d1d8396a79de7d2493c" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:05.070151 23745 leader_election.cc:341] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.070509 23745 leader_election.cc:302] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.072081 24262 ts_tablet_manager.cc:1397] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.005s
I20260807 11:09:05.074461 24262 raft_consensus.cc:348] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.075198 25338 raft_consensus.cc:2726] T 9c4f1adf1fb9450cba3de70397beaa2b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.075405 24262 raft_consensus.cc:374] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.075749 24262 raft_consensus.cc:729] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.076346 24262 consensus_queue.cc:260] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.078063 25139 raft_consensus.cc:2726] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.066730 24261 raft_consensus.cc:374] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.079095 24261 raft_consensus.cc:729] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.079561 24262 ts_tablet_manager.cc:1428] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 11:09:05.079680 24261 consensus_queue.cc:260] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:05.081636 24261 ts_tablet_manager.cc:1428] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.024s user 0.003s sys 0.000s
I20260807 11:09:05.083814 24262 tablet_bootstrap.cc:492] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:05.085089 24261 tablet_bootstrap.cc:492] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:05.089144 24262 tablet_bootstrap.cc:654] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.105736 25240 consensus_queue.cc:1035] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 11:09:05.110983 24266 tablet_bootstrap.cc:492] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:05.111390 24266 ts_tablet_manager.cc:1397] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.145s user 0.012s sys 0.001s
I20260807 11:09:05.114187 24266 raft_consensus.cc:348] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.117077 24266 raft_consensus.cc:374] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.117316 24266 raft_consensus.cc:729] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.123528 24266 consensus_queue.cc:260] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.129585 24266 ts_tablet_manager.cc:1428] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.018s user 0.004s sys 0.001s
I20260807 11:09:05.141949 24266 tablet_bootstrap.cc:492] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:05.157850 24266 tablet_bootstrap.cc:654] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:05.164333 23142 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.740s (SENT) [suppressed 1 similar messages]
I20260807 11:09:05.150764 24262 tablet_bootstrap.cc:492] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:05.165377 24262 ts_tablet_manager.cc:1397] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.082s user 0.009s sys 0.013s
I20260807 11:09:05.190739 24261 tablet_bootstrap.cc:654] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.201381 24262 raft_consensus.cc:348] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.202064 24262 raft_consensus.cc:374] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.202311 24262 raft_consensus.cc:729] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.206651 24266 tablet_bootstrap.cc:492] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:05.207124 25139 raft_consensus.cc:482] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.207455 25240 consensus_queue.cc:1035] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:05.207631 25139 raft_consensus.cc:504] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.209594 25139 leader_election.cc:288] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:05.210366 24266 ts_tablet_manager.cc:1397] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.069s user 0.010s sys 0.000s
I20260807 11:09:05.202929 24262 consensus_queue.cc:260] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.212365 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:05.213557 23745 leader_election.cc:341] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.213835 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:05.214969 23745 leader_election.cc:341] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.215317 23745 leader_election.cc:302] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.224459 24266 raft_consensus.cc:348] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:05.225243 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 60931.1us
I20260807 11:09:05.225797 25346 raft_consensus.cc:2726] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.227391 24266 raft_consensus.cc:374] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.227568 24262 ts_tablet_manager.cc:1428] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.061s user 0.005s sys 0.000s
I20260807 11:09:05.227752 24266 raft_consensus.cc:729] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.228452 24262 tablet_bootstrap.cc:492] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:05.228706 24266 consensus_queue.cc:260] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.230986 24266 ts_tablet_manager.cc:1428] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.020s user 0.003s sys 0.003s
I20260807 11:09:05.231837 24266 tablet_bootstrap.cc:492] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:05.236606 24266 tablet_bootstrap.cc:654] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.239130 25346 raft_consensus.cc:482] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.239611 25346 raft_consensus.cc:504] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.241551 25346 leader_election.cc:288] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:05.244067 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a427e865f1c4d938483a8222a95307e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:05.245141 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a427e865f1c4d938483a8222a95307e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:05.248090 24261 tablet_bootstrap.cc:492] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:05.248513 24261 ts_tablet_manager.cc:1397] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.164s user 0.006s sys 0.009s
W20260807 11:09:05.251148 23745 leader_election.cc:341] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:05.251761 23745 leader_election.cc:341] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.252087 23745 leader_election.cc:302] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.250804 24261 raft_consensus.cc:348] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.254163 24261 raft_consensus.cc:374] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.254617 24261 raft_consensus.cc:729] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.255267 24261 consensus_queue.cc:260] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.257201 24261 ts_tablet_manager.cc:1428] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 11:09:05.258080 24261 tablet_bootstrap.cc:492] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:05.270561 24261 tablet_bootstrap.cc:654] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.278316 24262 tablet_bootstrap.cc:654] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.278998 25346 raft_consensus.cc:2726] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.296686 24262 tablet_bootstrap.cc:492] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:05.297164 24262 ts_tablet_manager.cc:1397] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.003s
I20260807 11:09:05.299422 24262 raft_consensus.cc:348] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.300196 24262 raft_consensus.cc:374] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.300513 24262 raft_consensus.cc:729] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.301141 24262 consensus_queue.cc:260] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.302772 24261 tablet_bootstrap.cc:492] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:05.303174 24261 ts_tablet_manager.cc:1397] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.000s
I20260807 11:09:05.306735 24262 ts_tablet_manager.cc:1428] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260807 11:09:05.306941 24261 raft_consensus.cc:348] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.315132 24261 raft_consensus.cc:374] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.315408 24261 raft_consensus.cc:729] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.316025 24261 consensus_queue.cc:260] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.321547 24261 ts_tablet_manager.cc:1428] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260807 11:09:05.326666 25240 raft_consensus.cc:482] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.327122 25240 raft_consensus.cc:504] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.329027 25240 leader_election.cc:288] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.330624 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:05.343143 24261 tablet_bootstrap.cc:492] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:05.353710 24261 tablet_bootstrap.cc:654] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.312114 25346 raft_consensus.cc:482] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.363058 25346 raft_consensus.cc:504] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.364993 25346 leader_election.cc:288] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:05.330101 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20f0ba778a14d71b9e5efa113c784ff" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.365743 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:05.366475 23951 leader_election.cc:302] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:05.367239 25240 raft_consensus.cc:2726] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.368096 24262 tablet_bootstrap.cc:492] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:05.367985 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:05.369187 23745 leader_election.cc:341] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:05.369805 23745 leader_election.cc:341] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.370148 23745 leader_election.cc:302] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.371762 24266 tablet_bootstrap.cc:492] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:05.372198 24266 ts_tablet_manager.cc:1397] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.141s user 0.012s sys 0.005s
I20260807 11:09:05.379053 25346 raft_consensus.cc:2726] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.385047 25334 raft_consensus.cc:482] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.385493 25334 raft_consensus.cc:504] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:05.387310 25334 leader_election.cc:288] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:05.388931 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:05.391753 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4a0700315457384e3ca995de8a4f2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.392503 23840 raft_consensus.cc:2379] T 64c4a0700315457384e3ca995de8a4f2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a668588fabb4a9eba107cd6020f1e93 in current term 1: Already voted for candidate c281254655c84a0496c50045c37b22df in this term.
I20260807 11:09:05.394594 23507 leader_election.cc:302] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.395301 25339 raft_consensus.cc:3037] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.399324 25338 consensus_queue.cc:1035] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:05.401680 24262 tablet_bootstrap.cc:654] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.404675 25139 raft_consensus.cc:482] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.405114 25139 raft_consensus.cc:504] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.406392 25339 raft_consensus.cc:2726] T 64c4a0700315457384e3ca995de8a4f2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.407128 25139 leader_election.cc:288] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:05.408309 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3011806841f46f898920b1a11404f85" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:05.411402 23745 leader_election.cc:341] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.411835 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3011806841f46f898920b1a11404f85" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:05.412921 23745 leader_election.cc:341] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.413267 23745 leader_election.cc:302] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.413908 25139 raft_consensus.cc:2726] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.427069 25338 raft_consensus.cc:482] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.427644 25338 raft_consensus.cc:504] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:05.429790 25338 leader_election.cc:288] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.432106 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:05.432543 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.433159 23840 raft_consensus.cc:2454] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
W20260807 11:09:05.433396 23510 leader_election.cc:341] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.442628 25240 consensus_queue.cc:1035] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:05.445384 25139 raft_consensus.cc:482] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.445796 25139 raft_consensus.cc:504] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.447603 25139 leader_election.cc:288] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:05.450875 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:05.452314 23745 leader_election.cc:341] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.453702 24262 tablet_bootstrap.cc:492] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:05.454129 24262 ts_tablet_manager.cc:1397] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.086s user 0.010s sys 0.000s
I20260807 11:09:05.456729 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:05.457808 23745 leader_election.cc:341] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.458189 23745 leader_election.cc:302] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.458817 25139 raft_consensus.cc:2726] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.459403 24262 raft_consensus.cc:348] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.464057 24261 tablet_bootstrap.cc:492] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:05.463551 24262 raft_consensus.cc:374] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.466091 23507 leader_election.cc:302] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:05.465222 24262 raft_consensus.cc:729] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.470536 25339 raft_consensus.cc:2781] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:05.470947 25339 raft_consensus.cc:482] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:05.471309 25339 raft_consensus.cc:3037] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.469728 24262 consensus_queue.cc:260] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.484462 24262 ts_tablet_manager.cc:1428] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.030s user 0.010s sys 0.000s
I20260807 11:09:05.474788 24261 ts_tablet_manager.cc:1397] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.132s user 0.011s sys 0.011s
I20260807 11:09:05.490015 24262 tablet_bootstrap.cc:492] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:05.494638 25240 consensus_queue.cc:1035] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:05.494258 24266 raft_consensus.cc:348] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.501596 24266 raft_consensus.cc:374] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.501919 24266 raft_consensus.cc:729] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.502687 24266 consensus_queue.cc:260] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.512478 24261 raft_consensus.cc:348] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.513172 24261 raft_consensus.cc:374] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.513422 24261 raft_consensus.cc:729] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.513942 24261 consensus_queue.cc:260] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.532562 24261 ts_tablet_manager.cc:1428] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20260807 11:09:05.538281 25421 raft_consensus.cc:482] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.538820 25421 raft_consensus.cc:504] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.541886 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.543641 25421 leader_election.cc:288] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.544590 24261 tablet_bootstrap.cc:492] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:05.558813 24262 tablet_bootstrap.cc:654] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.569938 25428 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:05.571743 24261 tablet_bootstrap.cc:654] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.578944 25240 consensus_queue.cc:1035] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:05.570451 25428 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:05.587771 23187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:09:05.591717 25428 leader_election.cc:288] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309)
I20260807 11:09:05.606765 24261 tablet_bootstrap.cc:492] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:05.607690 24261 ts_tablet_manager.cc:1397] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.000s
I20260807 11:09:05.610402 24261 raft_consensus.cc:348] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.619407 24261 raft_consensus.cc:374] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.620065 24261 raft_consensus.cc:729] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.623809 24261 consensus_queue.cc:260] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.629522 24057 raft_consensus.cc:3037] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.635407 25346 raft_consensus.cc:482] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.635874 25346 raft_consensus.cc:504] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.637820 25346 leader_election.cc:288] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:05.639638 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:05.640990 23745 leader_election.cc:341] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.649061 24261 ts_tablet_manager.cc:1428] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260807 11:09:05.649998 24261 tablet_bootstrap.cc:492] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:05.664567 24261 tablet_bootstrap.cc:654] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.694871 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:05.696370 23745 leader_election.cc:341] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:05.696766 23745 leader_election.cc:302] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.697729 25346 raft_consensus.cc:2726] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.700433 24266 ts_tablet_manager.cc:1428] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.328s user 0.005s sys 0.000s
I20260807 11:09:05.709602 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb1504be4320471687d86a55a9891081" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:05.719460 24054 raft_consensus.cc:3037] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.745217 25339 raft_consensus.cc:504] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:05.765587 24266 tablet_bootstrap.cc:492] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:05.779685 24262 tablet_bootstrap.cc:492] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:05.780105 24262 ts_tablet_manager.cc:1397] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.291s user 0.042s sys 0.007s
I20260807 11:09:05.782269 24262 raft_consensus.cc:348] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.782930 24262 raft_consensus.cc:374] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.783174 24262 raft_consensus.cc:729] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.799067 24262 consensus_queue.cc:260] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.801146 24262 ts_tablet_manager.cc:1428] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.021s user 0.002s sys 0.003s
I20260807 11:09:05.801491 24048 raft_consensus.cc:3037] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.802013 24262 tablet_bootstrap.cc:492] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:05.752534 24261 tablet_bootstrap.cc:492] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:05.823231 24261 ts_tablet_manager.cc:1397] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.173s user 0.006s sys 0.005s
I20260807 11:09:05.838580 24262 tablet_bootstrap.cc:654] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.852437 24261 raft_consensus.cc:348] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.853142 24261 raft_consensus.cc:374] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.853401 24261 raft_consensus.cc:729] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.853940 24261 consensus_queue.cc:260] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.858911 23614 raft_consensus.cc:3037] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.863554 25421 raft_consensus.cc:482] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.863991 25421 raft_consensus.cc:504] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.866263 25421 leader_election.cc:288] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.868014 24261 ts_tablet_manager.cc:1428] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260807 11:09:05.868530 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.868896 24261 tablet_bootstrap.cc:492] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:05.869169 23840 raft_consensus.cc:2454] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:05.871554 23507 leader_election.cc:302] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:05.872480 25420 raft_consensus.cc:2781] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:05.872789 25420 raft_consensus.cc:482] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:05.873173 25420 raft_consensus.cc:3037] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.875615 25413 raft_consensus.cc:482] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.876084 25413 raft_consensus.cc:504] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.878191 25413 leader_election.cc:288] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.879310 25339 leader_election.cc:288] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.879583 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.880170 23840 raft_consensus.cc:2454] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:05.881770 23507 leader_election.cc:302] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:05.882813 25423 raft_consensus.cc:2781] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:05.883184 25423 raft_consensus.cc:482] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:05.883621 25423 raft_consensus.cc:3037] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.889730 24261 tablet_bootstrap.cc:654] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.891717 24262 tablet_bootstrap.cc:492] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:05.891628 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:05.892143 24262 ts_tablet_manager.cc:1397] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.090s user 0.006s sys 0.004s
I20260807 11:09:05.892719 23836 raft_consensus.cc:3037] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.894531 24262 raft_consensus.cc:348] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.895200 24262 raft_consensus.cc:374] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:05.899644 24266 tablet_bootstrap.cc:654] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:05.895970 23510 leader_election.cc:302] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93; no voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df
I20260807 11:09:05.894464 25423 raft_consensus.cc:504] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.908648 25230 raft_consensus.cc:482] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a668588fabb4a9eba107cd6020f1e93)
I20260807 11:09:05.895432 24262 raft_consensus.cc:729] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:05.909536 24262 consensus_queue.cc:260] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.909358 25230 raft_consensus.cc:504] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.911783 24262 ts_tablet_manager.cc:1428] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260807 11:09:05.916066 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.922235 25230 leader_election.cc:288] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.922281 25420 raft_consensus.cc:504] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.926244 25420 leader_election.cc:288] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.929162 25423 leader_election.cc:288] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.931906 25421 raft_consensus.cc:2726] T fb1504be4320471687d86a55a9891081 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:05.936751 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:05.936683 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:05.934445 25421 consensus_queue.cc:1035] T b3c9141f12804a96994994730996898b P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 11:09:05.937273 23844 raft_consensus.cc:3037] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.938030 25413 raft_consensus.cc:482] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.938448 25413 raft_consensus.cc:504] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.937296 23840 raft_consensus.cc:3037] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.940582 25413 leader_election.cc:288] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:05.942039 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:05.942626 23837 raft_consensus.cc:2454] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:05.943010 25230 raft_consensus.cc:482] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:05.943518 25230 raft_consensus.cc:504] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.944552 23844 raft_consensus.cc:2454] T aea90f7a10234f2da4fff089afe87a1e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:05.945284 23507 leader_election.cc:302] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:05.946120 23507 leader_election.cc:302] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:05.947332 25339 raft_consensus.cc:2781] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:05.947690 25339 raft_consensus.cc:482] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:05.948052 25339 raft_consensus.cc:3037] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:05.951809 25338 raft_consensus.cc:2781] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:05.952729 25338 raft_consensus.cc:686] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:05.961123 23840 raft_consensus.cc:2454] T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:05.960072 25338 consensus_queue.cc:237] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:05.962371 23507 leader_election.cc:302] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:05.963188 25334 raft_consensus.cc:2781] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:05.963639 25334 raft_consensus.cc:686] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:05.964534 25334 consensus_queue.cc:237] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:05.967042 23142 leader_election.cc:334] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.740s (SENT)
I20260807 11:09:05.967587 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:05.979931 24262 tablet_bootstrap.cc:492] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:09:05.982501 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 50823.7us
I20260807 11:09:06.001708 24262 tablet_bootstrap.cc:654] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.018056 25421 raft_consensus.cc:482] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.018666 25421 raft_consensus.cc:504] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.022244 25421 leader_election.cc:288] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.022800 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:06.023572 23840 raft_consensus.cc:2454] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:06.024991 23507 leader_election.cc:302] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:06.028659 24262 tablet_bootstrap.cc:492] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:06.029050 24262 ts_tablet_manager.cc:1397] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.009s
I20260807 11:09:06.029551 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:06.025892 25334 raft_consensus.cc:2781] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:06.035462 25451 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:06.037398 24262 raft_consensus.cc:348] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.038084 24262 raft_consensus.cc:374] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.038331 24262 raft_consensus.cc:729] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
W20260807 11:09:06.039284 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 72289.9us
I20260807 11:09:06.045938 25334 raft_consensus.cc:482] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:06.045882 24262 consensus_queue.cc:260] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.046422 25334 raft_consensus.cc:3037] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.047504 24262 ts_tablet_manager.cc:1428] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260807 11:09:06.029412 25230 leader_election.cc:288] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.050424 25439 consensus_queue.cc:1035] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:06.052551 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.060334 24261 tablet_bootstrap.cc:492] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:06.060983 24261 ts_tablet_manager.cc:1397] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.192s user 0.018s sys 0.009s
I20260807 11:09:06.063408 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.063933 24261 raft_consensus.cc:348] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.064641 24261 raft_consensus.cc:374] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.064882 24261 raft_consensus.cc:729] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.065531 24261 consensus_queue.cc:260] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.066009 24054 raft_consensus.cc:3037] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.071319 24262 tablet_bootstrap.cc:492] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:06.075417 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:06.080742 24261 ts_tablet_manager.cc:1428] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260807 11:09:06.081744 24261 tablet_bootstrap.cc:492] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:06.086627 24261 tablet_bootstrap.cc:654] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.087014 25230 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.087435 25230 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.089605 25230 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.090579 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:06.091370 23840 raft_consensus.cc:2454] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c281254655c84a0496c50045c37b22df in term 1.
I20260807 11:09:06.092809 23951 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:09:06.100427 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:06.102324 25346 raft_consensus.cc:482] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.102596 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.102964 24262 tablet_bootstrap.cc:654] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.102785 25346 raft_consensus.cc:504] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.104700 25346 leader_election.cc:288] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.106184 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:06.107272 23745 leader_election.cc:341] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.107549 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:06.108894 23745 leader_election.cc:341] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.109028 25439 raft_consensus.cc:2781] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 11:09:06.109226 23745 leader_election.cc:302] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:06.109539 25439 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:06.109968 25439 raft_consensus.cc:3037] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Advancing to term 2
I20260807 11:09:06.110096 25346 raft_consensus.cc:2726] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.118048 24266 tablet_bootstrap.cc:492] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:06.123138 24266 ts_tablet_manager.cc:1397] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.358s user 0.011s sys 0.000s
I20260807 11:09:06.124617 24262 tablet_bootstrap.cc:492] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:06.119731 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:06.124788 25346 raft_consensus.cc:482] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.125042 24262 ts_tablet_manager.cc:1397] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.004s
I20260807 11:09:06.125241 25346 raft_consensus.cc:504] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.127131 25346 leader_election.cc:288] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.130427 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:06.131227 24261 tablet_bootstrap.cc:492] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:06.131613 24261 ts_tablet_manager.cc:1397] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.002s
W20260807 11:09:06.131512 23745 leader_election.cc:341] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.138914 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:06.140247 23745 leader_election.cc:341] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.140616 23745 leader_election.cc:302] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:06.141526 25346 raft_consensus.cc:2726] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.127221 24262 raft_consensus.cc:348] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.155481 24262 raft_consensus.cc:374] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.155736 24262 raft_consensus.cc:729] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.133859 24261 raft_consensus.cc:348] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:06.159543 24261 raft_consensus.cc:374] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.159793 24261 raft_consensus.cc:729] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.160349 24261 consensus_queue.cc:260] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:06.160774 25421 consensus_queue.cc:1035] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:06.162377 24261 ts_tablet_manager.cc:1428] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260807 11:09:06.168593 24266 raft_consensus.cc:348] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:06.158640 24262 consensus_queue.cc:260] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.171283 24262 ts_tablet_manager.cc:1428] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.046s user 0.007s sys 0.000s
I20260807 11:09:06.172181 24262 tablet_bootstrap.cc:492] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:06.173666 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf445e8bf20b46f0831e218bb8eb3397" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:06.181473 25339 raft_consensus.cc:504] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.225278 24262 tablet_bootstrap.cc:654] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.122494 25439 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.228130 24266 raft_consensus.cc:374] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.183223 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3c9141f12804a96994994730996898b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:06.201714 24261 tablet_bootstrap.cc:492] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:06.235633 24261 tablet_bootstrap.cc:654] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.236975 24266 raft_consensus.cc:729] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.237847 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:06.234061 23836 raft_consensus.cc:2454] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:06.247372 24262 tablet_bootstrap.cc:492] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:06.255596 24262 ts_tablet_manager.cc:1397] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.084s user 0.009s sys 0.003s
I20260807 11:09:06.256441 23507 leader_election.cc:302] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:06.257400 25420 raft_consensus.cc:2781] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:06.257893 25420 raft_consensus.cc:686] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:06.257800 24262 raft_consensus.cc:348] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.258460 24262 raft_consensus.cc:374] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.258705 24262 raft_consensus.cc:729] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.258843 25420 consensus_queue.cc:237] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:06.259404 24262 consensus_queue.cc:260] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.261737 24262 ts_tablet_manager.cc:1428] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 11:09:06.262643 24262 tablet_bootstrap.cc:492] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:06.263329 24266 consensus_queue.cc:260] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:06.265533 24266 ts_tablet_manager.cc:1428] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.142s user 0.003s sys 0.001s
I20260807 11:09:06.268090 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:06.271322 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.273041 25421 raft_consensus.cc:482] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.273547 25421 raft_consensus.cc:504] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:06.275794 25421 leader_election.cc:288] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:06.277762 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:06.278362 23844 raft_consensus.cc:2454] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:06.279825 23507 leader_election.cc:302] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:06.280601 25421 raft_consensus.cc:2781] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:06.280944 25421 raft_consensus.cc:482] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:06.281281 25421 raft_consensus.cc:3037] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.282994 25346 raft_consensus.cc:482] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.283432 25346 raft_consensus.cc:504] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.285243 25346 leader_election.cc:288] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.286974 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da4a85755e5a4f53ba2d785020b0a8e2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:06.288060 23745 leader_election.cc:341] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.289350 25346 raft_consensus.cc:482] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.289768 25346 raft_consensus.cc:504] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.292222 25346 leader_election.cc:288] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.293021 24262 tablet_bootstrap.cc:654] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.293391 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:06.294332 23745 leader_election.cc:341] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.295074 24048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da4a85755e5a4f53ba2d785020b0a8e2" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.296437 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:06.298007 23745 leader_election.cc:341] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.298332 23745 leader_election.cc:302] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:06.299120 25439 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.299244 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
W20260807 11:09:06.299403 23745 leader_election.cc:341] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.299836 23745 leader_election.cc:302] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:06.300730 25346 raft_consensus.cc:2726] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.301210 25346 raft_consensus.cc:2726] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.311097 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:06.311751 23836 raft_consensus.cc:3037] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.317016 24262 tablet_bootstrap.cc:492] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:06.317440 24262 ts_tablet_manager.cc:1397] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.055s user 0.010s sys 0.000s
I20260807 11:09:06.316974 25334 raft_consensus.cc:504] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.319602 24262 raft_consensus.cc:348] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.320227 24262 raft_consensus.cc:374] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.320466 24262 raft_consensus.cc:729] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.321002 24262 consensus_queue.cc:260] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.322986 24262 ts_tablet_manager.cc:1428] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 11:09:06.323781 24262 tablet_bootstrap.cc:492] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:06.328539 25339 leader_election.cc:288] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.330191 23954 leader_election.cc:302] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:06.333451 23954 leader_election.cc:302] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:06.334326 25240 raft_consensus.cc:2726] T cf445e8bf20b46f0831e218bb8eb3397 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:06.335150 25240 raft_consensus.cc:2726] T b3c9141f12804a96994994730996898b P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:06.339516 23954 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:06.340482 25230 raft_consensus.cc:2726] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 11:09:06.347620 24262 tablet_bootstrap.cc:654] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.360199 25473 raft_consensus.cc:482] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.360718 25473 raft_consensus.cc:504] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.362416 24262 tablet_bootstrap.cc:492] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:06.362581 25473 leader_election.cc:288] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:06.362800 24262 ts_tablet_manager.cc:1397] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.039s user 0.010s sys 0.000s
I20260807 11:09:06.363591 25473 raft_consensus.cc:482] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.363977 25473 raft_consensus.cc:504] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.364993 24262 raft_consensus.cc:348] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.366210 25473 leader_election.cc:288] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.365612 24262 raft_consensus.cc:374] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.367066 24262 raft_consensus.cc:729] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.367201 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:06.367800 24261 tablet_bootstrap.cc:492] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:06.367638 24262 consensus_queue.cc:260] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.368191 24261 ts_tablet_manager.cc:1397] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.167s user 0.012s sys 0.000s
W20260807 11:09:06.368458 23745 leader_election.cc:341] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.365483 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:06.370222 23745 leader_election.cc:341] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.370430 24261 raft_consensus.cc:348] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.371089 24261 raft_consensus.cc:374] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.371335 24261 raft_consensus.cc:729] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.372265 24262 ts_tablet_manager.cc:1428] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260807 11:09:06.371917 24261 consensus_queue.cc:260] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.373351 24261 ts_tablet_manager.cc:1428] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 11:09:06.374189 24261 tablet_bootstrap.cc:492] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:06.377339 25421 raft_consensus.cc:504] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:06.383980 25473 raft_consensus.cc:482] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.384387 25473 raft_consensus.cc:504] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.386169 25473 leader_election.cc:288] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.395226 25439 raft_consensus.cc:482] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.395750 25439 raft_consensus.cc:504] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.411880 25230 raft_consensus.cc:482] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.412434 25230 raft_consensus.cc:504] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:06.430945 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.431473 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.431912 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:06.437175 23745 leader_election.cc:341] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.437562 23745 leader_election.cc:302] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
W20260807 11:09:06.438570 23745 leader_election.cc:341] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:06.439157 23745 leader_election.cc:341] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.439465 23745 leader_election.cc:302] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:06.440069 25473 raft_consensus.cc:2726] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.440315 25346 raft_consensus.cc:2726] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.444283 24266 tablet_bootstrap.cc:492] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:06.450572 25346 raft_consensus.cc:482] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.451015 25346 raft_consensus.cc:504] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.452792 25346 leader_election.cc:288] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.455190 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:06.455937 23840 raft_consensus.cc:2379] T ed62b70f86f3457ab0315ff25e836ec6 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:06.458683 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:06.459327 23840 raft_consensus.cc:3037] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:06.454614 23951 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 5eaf45dad4a944dab77330db6fc53222
I20260807 11:09:06.455788 25439 leader_election.cc:288] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.469542 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:06.480939 23745 leader_election.cc:341] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.486202 25230 leader_election.cc:288] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.491456 23840 raft_consensus.cc:2454] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
W20260807 11:09:06.496708 23030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 133929us
I20260807 11:09:06.389559 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:06.390129 24261 tablet_bootstrap.cc:654] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.470818 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:06.507344 23510 leader_election.cc:341] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:06.534842 23510 leader_election.cc:341] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:06.536007 23510 leader_election.cc:341] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:06.536886 23510 leader_election.cc:341] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.555780 25230 raft_consensus.cc:482] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:09:06.537570 23745 leader_election.cc:341] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.565383 23745 leader_election.cc:302] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
W20260807 11:09:06.566471 23745 leader_election.cc:341] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.566833 23745 leader_election.cc:302] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:06.567847 25346 raft_consensus.cc:2726] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.568524 25346 raft_consensus.cc:2726] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.562219 25230 raft_consensus.cc:504] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
W20260807 11:09:06.595137 23951 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: d5260c798aa645e5becf393f06528f87
I20260807 11:09:06.603859 25481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:06.604678 25481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:06.607764 25230 leader_election.cc:288] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:06.612795 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 75931us
I20260807 11:09:06.538044 25420 consensus_queue.cc:1035] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:06.457535 25334 leader_election.cc:288] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.560227 24261 tablet_bootstrap.cc:492] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:06.614843 24261 ts_tablet_manager.cc:1397] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.241s user 0.016s sys 0.002s
I20260807 11:09:06.617465 24261 raft_consensus.cc:348] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.618093 24261 raft_consensus.cc:374] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.618331 24261 raft_consensus.cc:729] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.618918 24261 consensus_queue.cc:260] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.620980 24261 ts_tablet_manager.cc:1428] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 11:09:06.621748 24261 tablet_bootstrap.cc:492] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:06.566550 23507 leader_election.cc:302] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:09:06.622920 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 56454.2us
I20260807 11:09:06.625159 25420 raft_consensus.cc:2781] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:06.625566 25420 raft_consensus.cc:686] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:06.626463 25420 consensus_queue.cc:237] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.634290 24261 tablet_bootstrap.cc:654] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:06.639494 23029 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 02d17f09961641ca8c4d5a64f0fcadf8 consensus state has no leader
I20260807 11:09:06.638376 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:06.640625 23840 raft_consensus.cc:3037] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.569895 25421 leader_election.cc:288] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:06.648968 23836 raft_consensus.cc:2454] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:06.650208 23507 leader_election.cc:302] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:06.651131 25334 raft_consensus.cc:2781] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:06.651592 25334 raft_consensus.cc:686] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:06.652493 24261 tablet_bootstrap.cc:492] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:06.652890 24261 ts_tablet_manager.cc:1397] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.005s
I20260807 11:09:06.655139 24266 tablet_bootstrap.cc:654] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.663447 24261 raft_consensus.cc:348] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.664098 24261 raft_consensus.cc:374] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.664340 24261 raft_consensus.cc:729] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.664886 24261 consensus_queue.cc:260] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.677605 24261 ts_tablet_manager.cc:1428] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.024s user 0.006s sys 0.001s
I20260807 11:09:06.678452 24261 tablet_bootstrap.cc:492] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:06.652451 25334 consensus_queue.cc:237] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:06.613466 23510 leader_election.cc:341] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:06.690940 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 77502.6us
W20260807 11:09:06.691623 23510 leader_election.cc:341] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.700752 24261 tablet_bootstrap.cc:654] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:06.706017 23510 leader_election.cc:341] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.715428 24681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:09:06.714143 25481 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:09:06.730532 24261 tablet_bootstrap.cc:492] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:06.730938 24261 ts_tablet_manager.cc:1397] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.009s
I20260807 11:09:06.762391 23840 raft_consensus.cc:2454] T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
W20260807 11:09:06.764106 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 52316.7us
I20260807 11:09:06.764925 23507 leader_election.cc:302] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:06.765369 24261 raft_consensus.cc:348] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.765997 24261 raft_consensus.cc:374] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.766238 24261 raft_consensus.cc:729] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.766776 24261 consensus_queue.cc:260] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.768693 24261 ts_tablet_manager.cc:1428] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.038s user 0.004s sys 0.000s
I20260807 11:09:06.766083 25414 raft_consensus.cc:2781] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:06.769291 25414 raft_consensus.cc:686] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:06.770012 25414 consensus_queue.cc:237] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:09:06.796883 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 86566.5us
I20260807 11:09:06.800227 24266 tablet_bootstrap.cc:492] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:06.800657 24266 ts_tablet_manager.cc:1397] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.357s user 0.006s sys 0.003s
I20260807 11:09:06.802920 24266 raft_consensus.cc:348] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.803624 24266 raft_consensus.cc:374] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.803870 24266 raft_consensus.cc:729] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.804457 24266 consensus_queue.cc:260] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.806512 24266 ts_tablet_manager.cc:1428] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260807 11:09:06.814774 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:06.820080 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:06.830139 24561 leader_election.cc:334] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.605s (SENT)
I20260807 11:09:06.830554 24561 leader_election.cc:302] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b43b3e5203ee4ac3a23fa1902356994b; no voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822
I20260807 11:09:06.841323 25491 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:06.846149 24043 raft_consensus.cc:3037] T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.857856 24261 tablet_bootstrap.cc:492] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:06.863620 24266 tablet_bootstrap.cc:492] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:06.869239 24261 tablet_bootstrap.cc:654] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.869743 25473 raft_consensus.cc:482] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.870244 25473 raft_consensus.cc:504] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.872267 25473 leader_election.cc:288] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.875087 24266 tablet_bootstrap.cc:654] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:06.876098 25339 raft_consensus.cc:482] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.876684 25339 raft_consensus.cc:504] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.879496 25339 leader_election.cc:288] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.886508 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:06.889636 24261 tablet_bootstrap.cc:492] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:06.890017 24261 ts_tablet_manager.cc:1397] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.000s
I20260807 11:09:06.897137 24266 tablet_bootstrap.cc:492] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:06.897567 24266 ts_tablet_manager.cc:1397] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.009s
I20260807 11:09:06.900295 24266 raft_consensus.cc:348] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.900940 24266 raft_consensus.cc:374] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.901176 24266 raft_consensus.cc:729] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.901736 24266 consensus_queue.cc:260] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.917064 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:06.918550 23745 leader_election.cc:341] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.918663 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:06.920096 23745 leader_election.cc:341] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:06.920451 23745 leader_election.cc:302] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:06.921485 25473 raft_consensus.cc:2726] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:06.907243 24261 raft_consensus.cc:348] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:06.923835 24261 raft_consensus.cc:374] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:06.932989 24261 raft_consensus.cc:729] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:06.934394 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:06.938992 24266 ts_tablet_manager.cc:1428] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.041s user 0.006s sys 0.001s
I20260807 11:09:06.939489 24261 consensus_queue.cc:260] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:06.953747 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:06.956465 23836 raft_consensus.cc:2454] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:06.960781 25473 raft_consensus.cc:482] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.961293 25473 raft_consensus.cc:504] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.964128 25473 leader_election.cc:288] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:06.959554 23507 leader_election.cc:302] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:06.965006 25414 raft_consensus.cc:2781] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:06.965387 25414 raft_consensus.cc:482] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:06.965837 25414 raft_consensus.cc:3037] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.966300 24261 ts_tablet_manager.cc:1428] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.076s user 0.004s sys 0.003s
I20260807 11:09:06.969156 24266 tablet_bootstrap.cc:492] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:06.941610 24051 raft_consensus.cc:1226] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Rejecting Update request from peer 8a668588fabb4a9eba107cd6020f1e93 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 11:09:06.979286 25339 raft_consensus.cc:482] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:06.979722 25339 raft_consensus.cc:504] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:06.980664 25334 consensus_queue.cc:1035] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:06.982184 25339 leader_election.cc:288] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:06.983503 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907f602c4dce41389e06307270c16f71" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:06.984104 23844 raft_consensus.cc:2454] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:06.985078 23507 leader_election.cc:302] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:06.985790 25334 raft_consensus.cc:2781] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:06.986107 25334 raft_consensus.cc:482] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:06.986403 25334 raft_consensus.cc:3037] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:06.992280 25414 raft_consensus.cc:504] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.002920 24261 tablet_bootstrap.cc:492] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:07.021816 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed62b70f86f3457ab0315ff25e836ec6" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:07.024658 25414 leader_election.cc:288] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:07.030409 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:07.028785 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:07.031142 23837 raft_consensus.cc:3037] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.102447 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907f602c4dce41389e06307270c16f71" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:07.111421 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2108b1d026bb42a88f95fef8badb1d77" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:07.112002 23610 raft_consensus.cc:2454] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:09:07.119156 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2108b1d026bb42a88f95fef8badb1d77" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:07.021319 24266 tablet_bootstrap.cc:654] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:07.130201 24261 tablet_bootstrap.cc:654] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:07.136442 23954 leader_election.cc:341] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 5eaf45dad4a944dab77330db6fc53222
I20260807 11:09:07.136821 23954 leader_election.cc:302] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:07.137450 25230 raft_consensus.cc:2726] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:07.136307 25495 raft_consensus.cc:482] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.145323 23745 leader_election.cc:302] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.149657 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:07.152232 25230 raft_consensus.cc:482] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.152765 25230 raft_consensus.cc:504] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.154650 25230 leader_election.cc:288] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:07.160807 23954 leader_election.cc:302] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:07.161463 25230 raft_consensus.cc:3037] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:07.162379 23954 leader_election.cc:341] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: d5260c798aa645e5becf393f06528f87
I20260807 11:09:07.162727 23954 leader_election.cc:302] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:07.164104 25439 raft_consensus.cc:2726] T d5260c798aa645e5becf393f06528f87 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:07.167869 25230 raft_consensus.cc:2726] T ed62b70f86f3457ab0315ff25e836ec6 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:07.168076 25494 log.cc:924] Time spent T 7a7ccf34faf345998028f67921927f0e P c281254655c84a0496c50045c37b22df: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260807 11:09:07.171854 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:07.172691 23840 raft_consensus.cc:2379] T e5685972a6dd45a3806f7a096bffd492 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
W20260807 11:09:07.174314 25497 log.cc:924] Time spent T 6a92aa4664c54114a8816710820e3864 P 99a8d4e2c1b14150b03ad0f28e74a011: Append to log took a long time: real 0.139s user 0.001s sys 0.000s
I20260807 11:09:07.176810 25414 consensus_queue.cc:1035] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:07.187032 25346 raft_consensus.cc:2781] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:07.187443 25346 raft_consensus.cc:482] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:07.187763 25346 raft_consensus.cc:3037] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.201851 24266 tablet_bootstrap.cc:492] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:07.202389 24266 ts_tablet_manager.cc:1397] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.233s user 0.010s sys 0.000s
W20260807 11:09:07.208134 23510 leader_election.cc:341] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:07.209841 23510 leader_election.cc:341] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.211949 25346 raft_consensus.cc:504] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.213985 25346 leader_election.cc:288] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:07.224885 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 79867.3us
W20260807 11:09:07.233976 23745 leader_election.cc:341] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.235752 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2108b1d026bb42a88f95fef8badb1d77" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:07.236291 23610 raft_consensus.cc:3037] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.238044 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2108b1d026bb42a88f95fef8badb1d77" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:07.245630 23610 raft_consensus.cc:2454] T 2108b1d026bb42a88f95fef8badb1d77 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:09:07.139057 25495 raft_consensus.cc:504] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.249886 23837 raft_consensus.cc:2454] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:07.250908 23507 leader_election.cc:302] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.251523 25413 raft_consensus.cc:482] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.251796 25495 leader_election.cc:288] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:07.251945 25413 raft_consensus.cc:504] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.255352 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a427e865f1c4d938483a8222a95307e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:07.255983 23837 raft_consensus.cc:2454] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:07.268584 24266 raft_consensus.cc:348] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.269287 24266 raft_consensus.cc:374] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:07.269522 24266 raft_consensus.cc:729] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:07.255676 23745 leader_election.cc:302] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
W20260807 11:09:07.280920 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 58633.8us
W20260807 11:09:07.289733 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 77410.5us
W20260807 11:09:07.290481 23510 leader_election.cc:341] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.291550 25421 raft_consensus.cc:2781] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:07.291990 25421 raft_consensus.cc:686] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:07.292716 25421 consensus_queue.cc:237] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.293517 24261 tablet_bootstrap.cc:492] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:07.293877 24261 ts_tablet_manager.cc:1397] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.291s user 0.006s sys 0.003s
I20260807 11:09:07.295080 23507 leader_election.cc:302] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.240097 25334 raft_consensus.cc:504] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.303220 24266 consensus_queue.cc:260] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.254468 25413 leader_election.cc:288] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:07.316788 25339 raft_consensus.cc:2781] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:07.329126 25339 raft_consensus.cc:482] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:07.329468 25339 raft_consensus.cc:3037] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.329312 24261 raft_consensus.cc:348] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.329959 24261 raft_consensus.cc:374] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:07.330214 24261 raft_consensus.cc:729] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:07.331349 25513 raft_consensus.cc:2781] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:07.331853 25513 raft_consensus.cc:686] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:09:07.332625 25513 consensus_queue.cc:237] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.330792 24261 consensus_queue.cc:260] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.336463 25439 raft_consensus.cc:482] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.336915 25439 raft_consensus.cc:504] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:07.338792 25439 leader_election.cc:288] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:07.340217 23951 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
W20260807 11:09:07.356312 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 64983.6us
W20260807 11:09:07.357580 23510 leader_election.cc:341] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.359995 24261 ts_tablet_manager.cc:1428] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.066s user 0.007s sys 0.001s
I20260807 11:09:07.361615 24261 tablet_bootstrap.cc:492] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:07.365994 25334 leader_election.cc:288] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:07.374310 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 79293.1us
I20260807 11:09:07.376374 24266 ts_tablet_manager.cc:1428] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.174s user 0.005s sys 0.000s
W20260807 11:09:07.355401 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 97116.7us
W20260807 11:09:07.388969 23745 leader_election.cc:341] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.403200 24261 tablet_bootstrap.cc:654] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:07.408232 25339 raft_consensus.cc:504] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.410140 25339 leader_election.cc:288] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:07.414137 25439 raft_consensus.cc:482] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 11:09:07.415146 25519 log.cc:924] Time spent T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93: Append to log took a long time: real 0.116s user 0.000s sys 0.001s
I20260807 11:09:07.414592 25439 raft_consensus.cc:504] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:09:07.416428 23510 leader_election.cc:341] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.416746 25439 leader_election.cc:288] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:07.417362 25338 consensus_queue.cc:1046] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:07.419528 25414 raft_consensus.cc:3032] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 11:09:07.419541 23951 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:09:07.419857 25414 raft_consensus.cc:729] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:07.420567 25414 consensus_queue.cc:260] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.421727 25414 raft_consensus.cc:3037] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Advancing to term 2
W20260807 11:09:07.428301 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 53451.4us
I20260807 11:09:07.429442 24266 tablet_bootstrap.cc:492] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:07.430151 23835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907f602c4dce41389e06307270c16f71" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:07.430680 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a427e865f1c4d938483a8222a95307e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:07.430799 23835 raft_consensus.cc:3037] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.431247 23836 raft_consensus.cc:3037] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.438082 23836 raft_consensus.cc:2454] T 6a427e865f1c4d938483a8222a95307e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:07.437563 23835 raft_consensus.cc:2454] T 907f602c4dce41389e06307270c16f71 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
W20260807 11:09:07.442968 23510 leader_election.cc:341] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.456496 24266 tablet_bootstrap.cc:654] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:07.456102 24261 tablet_bootstrap.cc:492] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:07.460600 24261 ts_tablet_manager.cc:1397] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.099s user 0.008s sys 0.002s
I20260807 11:09:07.463946 23507 leader_election.cc:302] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.487349 23507 leader_election.cc:302] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.489678 25334 raft_consensus.cc:2781] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:07.490267 25334 raft_consensus.cc:686] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:07.491271 25334 consensus_queue.cc:237] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:07.496284 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 107498us
I20260807 11:09:07.497994 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:07.499477 25513 raft_consensus.cc:482] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.499900 25513 raft_consensus.cc:504] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:07.485976 23510 leader_election.cc:341] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.493335 25523 raft_consensus.cc:2781] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:07.501477 25523 raft_consensus.cc:686] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:07.502380 25513 leader_election.cc:288] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:07.502394 25523 consensus_queue.cc:237] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.504163 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:07.515990 23745 leader_election.cc:341] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.516732 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:07.516954 23745 leader_election.cc:341] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.517294 23745 leader_election.cc:302] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:07.517467 23613 raft_consensus.cc:2454] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:09:07.518474 25495 raft_consensus.cc:2726] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:07.518558 23745 leader_election.cc:302] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.519436 25495 raft_consensus.cc:2781] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:07.519841 25495 raft_consensus.cc:482] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:07.520195 25495 raft_consensus.cc:3037] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.526070 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:07.480055 24261 raft_consensus.cc:348] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.528579 24261 raft_consensus.cc:374] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:07.528891 24261 raft_consensus.cc:729] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:07.529039 25495 raft_consensus.cc:504] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.529579 24261 consensus_queue.cc:260] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.531234 24261 ts_tablet_manager.cc:1428] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.070s user 0.005s sys 0.001s
I20260807 11:09:07.532230 24261 tablet_bootstrap.cc:492] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:09:07.543805 23745 leader_election.cc:341] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.545745 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:07.548692 24266 tablet_bootstrap.cc:492] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:07.549110 24266 ts_tablet_manager.cc:1397] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.120s user 0.013s sys 0.001s
I20260807 11:09:07.541393 25495 leader_election.cc:288] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:07.565601 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a427e865f1c4d938483a8222a95307e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:07.566912 23745 leader_election.cc:341] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.570604 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a427e865f1c4d938483a8222a95307e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:07.572333 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907f602c4dce41389e06307270c16f71" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:07.576633 24266 raft_consensus.cc:348] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:07.539664 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 50171.3us
I20260807 11:09:07.544400 23613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:07.577669 23613 raft_consensus.cc:3037] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.595825 23613 raft_consensus.cc:2454] T c12bb5a459df41e0b0eb87534cb5959a P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:09:07.599164 23745 leader_election.cc:302] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:07.599871 25495 raft_consensus.cc:2781] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:07.601310 25495 raft_consensus.cc:686] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:09:07.602110 25495 consensus_queue.cc:237] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.577309 24266 raft_consensus.cc:374] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:07.610826 24266 raft_consensus.cc:729] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:07.612855 24266 consensus_queue.cc:260] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.636762 24266 ts_tablet_manager.cc:1428] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.087s user 0.002s sys 0.005s
I20260807 11:09:07.643769 24266 tablet_bootstrap.cc:492] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:07.653143 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5685972a6dd45a3806f7a096bffd492" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:07.675379 23954 leader_election.cc:302] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:07.676442 24261 tablet_bootstrap.cc:654] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:07.676581 23954 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
I20260807 11:09:07.676919 23954 leader_election.cc:302] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:07.677805 25230 raft_consensus.cc:3037] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.678601 25439 raft_consensus.cc:2726] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:07.682621 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_3296c53524e341ea9bd1f69a41aec0c4 [id=00906552217a443386552aeb9a487abd]
I20260807 11:09:07.685140 25230 raft_consensus.cc:2726] T e5685972a6dd45a3806f7a096bffd492 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:07.698334 25338 consensus_queue.cc:1035] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:07.699812 25338 consensus_queue.cc:1035] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:07.701512 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_b226b03cf22c4dbf9a1be5ec1499a367 [id=00a5f697df75490eaed389c034050304]
I20260807 11:09:07.703157 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_0e391a540a1f4eb09798376daa1dd533 [id=01bc2a49d75f4d11bbbb6a644e2498b3]
I20260807 11:09:07.706118 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_2cbdc073cd0242d9ba358f06215755d3 [id=03bf1751e8404c34a38d083358a153a1]
W20260807 11:09:07.712704 23510 consensus_peers.cc:487] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:07.713279 23510 consensus_peers.cc:487] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:07.727744 24266 tablet_bootstrap.cc:654] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:07.737202 24261 tablet_bootstrap.cc:492] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:07.737764 24261 ts_tablet_manager.cc:1397] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.206s user 0.006s sys 0.004s
I20260807 11:09:07.740113 25338 consensus_queue.cc:1035] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:07.742270 24261 raft_consensus.cc:348] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.742990 24261 raft_consensus.cc:374] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:07.743239 24261 raft_consensus.cc:729] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
W20260807 11:09:07.743270 23510 leader_election.cc:341] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.749254 25520 raft_consensus.cc:482] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.749869 25520 raft_consensus.cc:504] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:07.752925 25520 leader_election.cc:288] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:09:07.757616 23954 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 79873.2us
W20260807 11:09:07.758263 23954 leader_election.cc:341] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 0071aac25afa4100b98c4811cf3e6b2e
I20260807 11:09:07.758597 23954 leader_election.cc:302] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
W20260807 11:09:07.748407 23510 leader_election.cc:341] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:07.766294 23510 leader_election.cc:341] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.767313 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:07.767899 23844 raft_consensus.cc:2454] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:07.769980 23507 leader_election.cc:302] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.775866 25338 raft_consensus.cc:2781] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:07.776235 25338 raft_consensus.cc:482] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:07.776582 25338 raft_consensus.cc:3037] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.780131 25439 raft_consensus.cc:2726] T 0071aac25afa4100b98c4811cf3e6b2e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:07.781169 25439 raft_consensus.cc:482] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.781659 25439 raft_consensus.cc:504] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.786180 25439 leader_election.cc:288] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:07.786423 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:07.787144 23844 raft_consensus.cc:2379] T f3647d1473454c9ca1c8c2d3441586a2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:07.743875 24261 consensus_queue.cc:260] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.793478 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_9a56149cf3194cdf95b9d8ebb7565aee [id=0c35da9831c64205922aa00f91d5b80d]
I20260807 11:09:07.800410 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_81cea7b24eb8462093613254c16693bd [id=0f68d2c639d546d3ac76d6536949e2f5]
W20260807 11:09:07.800061 25541 log.cc:924] Time spent T 4b001bc080a14838a3fc58af982b792b P 99a8d4e2c1b14150b03ad0f28e74a011: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260807 11:09:07.803972 24261 ts_tablet_manager.cc:1428] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.066s user 0.003s sys 0.004s
I20260807 11:09:07.806010 24266 tablet_bootstrap.cc:492] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:07.806510 24266 ts_tablet_manager.cc:1397] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.163s user 0.007s sys 0.004s
I20260807 11:09:07.809332 24266 raft_consensus.cc:348] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.817570 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06]
I20260807 11:09:07.821094 24261 tablet_bootstrap.cc:492] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:07.822597 24266 raft_consensus.cc:374] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:07.829799 24266 raft_consensus.cc:729] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:07.838564 24266 consensus_queue.cc:260] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.845860 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_b691ab49ae6a48d4827f493634dc62e7 [id=18d7876a6bec428f8d44a9d68269539a]
I20260807 11:09:07.841554 24043 raft_consensus.cc:3037] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:07.846271 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3647d1473454c9ca1c8c2d3441586a2" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:07.845530 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:07.889640 24266 ts_tablet_manager.cc:1428] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.083s user 0.007s sys 0.000s
W20260807 11:09:07.897348 23142 leader_election.cc:334] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.614s (SENT)
I20260807 11:09:07.898186 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:07.899762 24261 tablet_bootstrap.cc:654] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:07.892640 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67]
W20260807 11:09:07.907503 23510 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 52979.1us
I20260807 11:09:07.912993 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_bcbbbb7ddd0840a7b45baef6133d5808 [id=251656231af64a1b9a66dbbd7f962071]
I20260807 11:09:07.936928 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_1ba07f688e5f42a18c6985eaf65e16e1 [id=282f43d738714393ba1c23189d039355]
I20260807 11:09:07.938935 23954 leader_election.cc:302] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:07.939611 25230 raft_consensus.cc:2726] T f3647d1473454c9ca1c8c2d3441586a2 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:07.945313 24266 tablet_bootstrap.cc:492] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:07.945020 25338 raft_consensus.cc:504] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:07.947871 25338 leader_election.cc:288] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:07.950915 25523 consensus_queue.cc:1035] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:07.955576 24266 tablet_bootstrap.cc:654] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:07.955574 23510 leader_election.cc:341] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:07.955049 25334 consensus_queue.cc:1035] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260807 11:09:07.962045 23908 debug-util.cc:398] Leaking SignalData structure 0x7b0800132180 after lost signal to thread 23709
I20260807 11:09:07.962417 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:07.963088 23840 raft_consensus.cc:3037] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:07.963297 23908 debug-util.cc:398] Leaking SignalData structure 0x7b08001483c0 after lost signal to thread 23911
I20260807 11:09:07.972359 23840 raft_consensus.cc:2454] T 26e0c103c9724de18cf95897f33a101a P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:07.975699 25230 raft_consensus.cc:482] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:07.976157 25230 raft_consensus.cc:504] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:07.978603 25230 leader_election.cc:288] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:07.985008 25334 consensus_queue.cc:1035] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:07.985770 25514 consensus_queue.cc:1035] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:07.986217 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:07.986622 23507 leader_election.cc:302] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:07.988283 25514 raft_consensus.cc:2781] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:07.988821 25514 raft_consensus.cc:686] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:07.990517 25514 consensus_queue.cc:237] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:07.993724 25553 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:09:07.996089 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 99129.3us
W20260807 11:09:08.010635 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 54008.5us
I20260807 11:09:08.021705 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:08.055004 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22]
I20260807 11:09:08.056867 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_f343bd15113d474ba791135714036936 [id=3a6709ec839444279264e56e47b6a0d7]
I20260807 11:09:08.065244 25523 raft_consensus.cc:482] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.067485 25338 raft_consensus.cc:482] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.067313 25523 raft_consensus.cc:504] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.067942 25338 raft_consensus.cc:504] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.069422 25523 leader_election.cc:288] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.070005 25338 leader_election.cc:288] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.062783 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aea90f7a10234f2da4fff089afe87a1e" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:08.091629 24266 tablet_bootstrap.cc:492] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:08.092140 24266 ts_tablet_manager.cc:1397] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.147s user 0.014s sys 0.001s
I20260807 11:09:08.096733 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_087f134702a64647bd34ce9f69e750e8 [id=3cdc318caab3417a9c47ffa7846ada47]
I20260807 11:09:08.098193 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9]
I20260807 11:09:08.100356 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d]
I20260807 11:09:08.094787 24266 raft_consensus.cc:348] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.140583 24266 raft_consensus.cc:374] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:08.143044 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484]
I20260807 11:09:08.143463 24266 raft_consensus.cc:729] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:08.144230 24266 consensus_queue.cc:260] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.147286 24266 ts_tablet_manager.cc:1428] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.055s user 0.006s sys 0.000s
I20260807 11:09:08.149307 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_89376166cd0b4be1ad5e90c84f809333 [id=44552a1ef4ac4136a8d4907501fc03ad]
I20260807 11:09:08.151285 24266 tablet_bootstrap.cc:492] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:08.161067 23954 leader_election.cc:302] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:08.161892 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:08.164543 25537 raft_consensus.cc:2726] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:08.173461 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c31c37cb2a4d1d8396a79de7d2493c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:08.199764 24261 tablet_bootstrap.cc:492] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:08.200188 24261 ts_tablet_manager.cc:1397] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.379s user 0.010s sys 0.011s
I20260807 11:09:08.219312 24266 tablet_bootstrap.cc:654] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:08.222970 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_9cc5f868b933436a9237ac18b3aaa690 [id=4b999790160a48d09074af28ebd16079]
I20260807 11:09:08.225835 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_30b02767d83b41a48e58f46544825d48 [id=4e04c93b9a4c4ce988f22fbe3a021742]
W20260807 11:09:08.227509 23510 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.115.253:40309, user_credentials={real_user=slave}} blocked reactor thread for 60455.5us
W20260807 11:09:08.228906 23510 leader_election.cc:341] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:08.202368 24261 raft_consensus.cc:348] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.232201 24261 raft_consensus.cc:374] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:08.232463 24261 raft_consensus.cc:729] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:08.236711 24261 consensus_queue.cc:260] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:08.237798 23510 leader_election.cc:341] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:08.239550 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_bd4ad9fadca04c0eaa62bf1d0f63e8cb [id=53967af96c72486f9aaa26abffa6fbfa]
I20260807 11:09:08.248091 25537 raft_consensus.cc:482] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.248584 25537 raft_consensus.cc:504] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.250546 25537 leader_election.cc:288] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.263377 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_df4c28e5effb4b60b90f040c46268eb7 [id=5920b1c2aacd403cac2ce78b06a57482]
W20260807 11:09:08.274525 23510 consensus_peers.cc:487] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:08.275801 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_776b2db76b154e8b8bc73b21a93265eb [id=5c4a7629628b43dd940b6de0264cb7cd]
I20260807 11:09:08.288259 24266 tablet_bootstrap.cc:492] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:08.288794 24266 ts_tablet_manager.cc:1397] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.138s user 0.010s sys 0.000s
I20260807 11:09:08.291095 24266 raft_consensus.cc:348] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.291877 24266 raft_consensus.cc:374] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:08.292171 24266 raft_consensus.cc:729] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:08.293965 23831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:08.295331 23831 raft_consensus.cc:2379] T e7aa352ec3434afb81933c3151c3742d P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:08.300791 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:08.301488 23836 raft_consensus.cc:2454] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:08.301338 24266 consensus_queue.cc:260] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.314730 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c31c37cb2a4d1d8396a79de7d2493c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:08.315564 23840 raft_consensus.cc:2454] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:08.324570 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_6d0d642c3b424c3388505b3ba6a6bb25 [id=6684170bb34949e7a0a3e10216b490bf]
I20260807 11:09:08.325028 24266 ts_tablet_manager.cc:1428] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.036s user 0.005s sys 0.000s
I20260807 11:09:08.326589 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]
I20260807 11:09:08.328142 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]
I20260807 11:09:08.331791 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]
W20260807 11:09:08.342384 23745 consensus_peers.cc:487] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:08.343508 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_c8e7c102b5df4cc6ac8958d6250ef4e6 [id=81710632f4754a50bbf43e0cd8d80296]
I20260807 11:09:08.349146 23507 leader_election.cc:302] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:08.349803 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a]
I20260807 11:09:08.350206 25334 consensus_queue.cc:1035] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:08.351405 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]
I20260807 11:09:08.351432 25334 raft_consensus.cc:2781] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:08.351722 25334 raft_consensus.cc:482] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:08.352032 25334 raft_consensus.cc:3037] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.353914 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_e4383b988f6941c9be5c4bbcc5425e76 [id=852d1ec4b63747218187fba2c75f2b87]
I20260807 11:09:08.355266 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_8aada9f80c114120b9fad92d59976579 [id=86a60d2c4fed45f8b7c1c15ea61847f8]
I20260807 11:09:08.357731 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_1e2e0850d0394751b215be889b722ade [id=8cb8accd8f7b4559824a1643fd9c100f]
I20260807 11:09:08.360320 25513 consensus_queue.cc:1035] T 2108b1d026bb42a88f95fef8badb1d77 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:08.359445 23507 leader_election.cc:302] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:08.367040 25421 raft_consensus.cc:2781] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:08.367401 25421 raft_consensus.cc:482] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:08.367690 25421 raft_consensus.cc:3037] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.367902 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_3d3d2c64ef784197815a34510666c5df [id=91a12abc12694046b152c42fedd52521]
I20260807 11:09:08.369315 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_308433d482ea452289ce2b3d63e5577d [id=93f43cefc3d74c9190ae50d66bcfb3ba]
I20260807 11:09:08.374963 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70]
I20260807 11:09:08.376323 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_d9bd2b2348cb4614a4bd7c207186a696 [id=97fa5c597042473aac2865ebebf63541]
I20260807 11:09:08.377595 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_9b7a6afec0d2423ea15d59b70e646e8d [id=9d1d8cf406384f4291a4f52655394cf0]
I20260807 11:09:08.378995 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_a6db15451abd4a1ca32ce8f2c440b936 [id=9e28a60150c04136b617507a6af99466]
I20260807 11:09:08.378775 25563 raft_consensus.cc:482] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.379532 25563 raft_consensus.cc:504] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.380347 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_3e30bbe8a73348c2a9af2b1e51fbe2f5 [id=9e5c4d1a3cc44af8a5067e542f7a4445]
I20260807 11:09:08.381629 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_6f8c96453d0f4d3f8465677953583882 [id=9e5c74477bb5499fa65ebac48712d2a3]
I20260807 11:09:08.391418 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_fbc2eeb603af4b3a84797af4a00deb52 [id=9fe3f76ee52549269d443fb394b22540]
I20260807 11:09:08.394915 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_57207993c2f443c6841b0228be8fe9b3 [id=a847486f994d4eaab42a77a907556f6d]
I20260807 11:09:08.403117 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_94689d0c00964dc88800aa0602ac5f73 [id=aa1b402a6ff34987b35696530cf94e5a]
I20260807 11:09:08.406659 25563 leader_election.cc:288] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.407008 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_f7407267f0e140289ed791ad730d154f [id=b132fefb831d4870aaddeee3f8e1479f]
I20260807 11:09:08.413265 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:08.414041 23846 raft_consensus.cc:2454] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:08.415212 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_94e16611ae8443e08052b5dc61520b02 [id=b7905a38d56448c8b4047f8ec0b6d9f4]
I20260807 11:09:08.416556 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8]
I20260807 11:09:08.417446 23507 leader_election.cc:302] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:08.417838 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_0e986c6a79d84a98b7351ebc3eac6415 [id=ba93341a8c3e469a93965e872dcf7686]
I20260807 11:09:08.418725 25414 raft_consensus.cc:2781] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:08.419133 25414 raft_consensus.cc:482] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:08.419516 25414 raft_consensus.cc:3037] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.420796 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_88d053e473434f119722cfed9e14a700 [id=c905367c134b46c9b29fa3837feae249]
I20260807 11:09:08.366616 25334 raft_consensus.cc:504] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.425526 25334 leader_election.cc:288] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.427680 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:08.428239 23846 raft_consensus.cc:3037] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.394322 25421 raft_consensus.cc:504] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.430614 25421 leader_election.cc:288] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.432947 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c31c37cb2a4d1d8396a79de7d2493c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:08.433503 23844 raft_consensus.cc:3037] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.435365 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]
I20260807 11:09:08.440215 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]
I20260807 11:09:08.441529 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_c3b1895765b44a4eae9efabea2a2e456 [id=d234e8cf6d8546639f2c3420c16b9cac]
W20260807 11:09:08.462828 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 187761us
W20260807 11:09:08.466248 23510 leader_election.cc:341] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:08.469535 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_179c7d3a61fa488a8941a27b63864037 [id=d649529acb514800845ee14d0803f79c]
I20260807 11:09:08.471454 24261 ts_tablet_manager.cc:1428] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.271s user 0.007s sys 0.000s
W20260807 11:09:08.472271 25575 log.cc:924] Time spent T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93: Append to log took a long time: real 0.155s user 0.001s sys 0.000s
I20260807 11:09:08.478240 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_a46f408876e040f7abc059e728d04a9c [id=d8165adfe8ce4053b5b35900f89cd0de]
I20260807 11:09:08.480754 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_250a3f4487f94d5c8dea2acabb1593ad [id=d96069ebf6b34dca829261fa6320aafc]
I20260807 11:09:08.482048 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]
I20260807 11:09:08.482618 25439 raft_consensus.cc:482] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.483070 25439 raft_consensus.cc:504] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.485162 25439 leader_election.cc:288] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:08.487427 23951 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
I20260807 11:09:08.488296 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_6142de128f694ccfb31fcbde5ffd7d94 [id=df7d6690afb347e890c89bbb8cbd8875]
I20260807 11:09:08.495321 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_8c7e5e4c285b42d7b553c1939691168d [id=e14499712b28410b8d9a1e8335b5da46]
I20260807 11:09:08.496569 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_ea2db3b5e44a42f78e63ba9a33356768 [id=e1fe10ed4bee4ca987b3dc755534d28e]
I20260807 11:09:08.497777 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_07911aa3b4c244118be60ebcc25a777a [id=e2e06aca451241a2b4d4c84ccabfc1fc]
I20260807 11:09:08.499656 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_3ad860f1514e47d9951f2ca82b21044f [id=e97c2a634a534b23a3ffd3699c86a28b]
I20260807 11:09:08.503425 24261 tablet_bootstrap.cc:492] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:08.506810 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_ba00760e26b94608849fcc974443fbb3 [id=efe7160043714311b979721eaa5d2b21]
I20260807 11:09:08.508085 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_68575b95a3f045c989a91bff8785baed [id=efebaf241d40428db31da62407816203]
I20260807 11:09:08.509786 23844 raft_consensus.cc:2454] T 11c31c37cb2a4d1d8396a79de7d2493c P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:08.510828 23507 leader_election.cc:302] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:08.511763 25421 raft_consensus.cc:2781] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:08.512228 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63]
I20260807 11:09:08.512248 25421 raft_consensus.cc:686] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:08.513096 25421 consensus_queue.cc:237] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.514423 24965 catalog_manager.cc:669] Loaded metadata for table default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e]
I20260807 11:09:08.518143 24043 raft_consensus.cc:3037] T aea90f7a10234f2da4fff089afe87a1e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.522202 25537 raft_consensus.cc:482] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.522656 25537 raft_consensus.cc:504] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.524515 25537 leader_election.cc:288] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.531085 23846 raft_consensus.cc:2454] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:08.532361 23507 leader_election.cc:302] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:08.533133 25334 raft_consensus.cc:2781] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:08.533515 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:08.533782 25334 raft_consensus.cc:686] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:08.534529 25334 consensus_queue.cc:237] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.476286 25414 raft_consensus.cc:504] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.580492 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:08.581061 23846 raft_consensus.cc:3037] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.582954 24261 tablet_bootstrap.cc:654] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:08.589138 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:08.590983 24965 tablet_loader.cc:96] loaded metadata for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8])
I20260807 11:09:08.593173 24965 tablet_loader.cc:96] loaded metadata for tablet 06a5e42d83ac4becb19a55d21040a3cc (table default.Table_600b8d2dc0da446f8d7a5d207e3485d7 [id=97b8ba1a7e2e4995a753f3daf7d79a70])
I20260807 11:09:08.593146 24052 raft_consensus.cc:3037] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.595057 24965 tablet_loader.cc:96] loaded metadata for tablet 08e14760bfd548308d8c71096964087a (table default.Table_250a3f4487f94d5c8dea2acabb1593ad [id=d96069ebf6b34dca829261fa6320aafc])
I20260807 11:09:08.599154 24965 tablet_loader.cc:96] loaded metadata for tablet 0d81cc2870864a30a62a20921273d55d (table default.Table_ba00760e26b94608849fcc974443fbb3 [id=efe7160043714311b979721eaa5d2b21])
I20260807 11:09:08.600781 25513 consensus_queue.cc:1035] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:08.606217 23846 raft_consensus.cc:2454] T cdd1a829d01c41f28a54cf4e3d9c3099 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:08.610930 23507 leader_election.cc:302] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:08.618479 24266 tablet_bootstrap.cc:492] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:08.625986 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:08.628037 24266 tablet_bootstrap.cc:654] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:08.632076 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c31c37cb2a4d1d8396a79de7d2493c" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:08.639684 25582 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:08.640301 25582 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:08.641459 24965 tablet_loader.cc:96] loaded metadata for tablet 1f3d4571045043eb8ec87b5f31871a09 (table default.Table_179c7d3a61fa488a8941a27b63864037 [id=d649529acb514800845ee14d0803f79c])
I20260807 11:09:08.645289 24266 tablet_bootstrap.cc:492] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:08.651399 24266 ts_tablet_manager.cc:1397] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.000s
I20260807 11:09:08.653075 24965 tablet_loader.cc:96] loaded metadata for tablet 2013df97d54d43aaa844154c200a5a4f (table default.Table_88d053e473434f119722cfed9e14a700 [id=c905367c134b46c9b29fa3837feae249])
I20260807 11:09:08.666374 24965 tablet_loader.cc:96] loaded metadata for tablet 2108b1d026bb42a88f95fef8badb1d77 (table default.Table_776b2db76b154e8b8bc73b21a93265eb [id=5c4a7629628b43dd940b6de0264cb7cd])
I20260807 11:09:08.664882 24266 raft_consensus.cc:348] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.668179 24266 raft_consensus.cc:374] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:08.669056 24266 raft_consensus.cc:729] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:08.670996 24266 consensus_queue.cc:260] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.672574 24965 tablet_loader.cc:96] loaded metadata for tablet 24f87bb654c84064b7bc26864ceb9755 (table default.Table_1e2e0850d0394751b215be889b722ade [id=8cb8accd8f7b4559824a1643fd9c100f])
I20260807 11:09:08.676016 24266 ts_tablet_manager.cc:1428] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260807 11:09:08.677083 24965 tablet_loader.cc:96] loaded metadata for tablet 25c60c0060b647d498ca71201bb0936b (table default.Table_ea2db3b5e44a42f78e63ba9a33356768 [id=e1fe10ed4bee4ca987b3dc755534d28e])
I20260807 11:09:08.684970 25414 leader_election.cc:288] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.690152 24965 tablet_loader.cc:96] loaded metadata for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (table default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7])
I20260807 11:09:08.694140 24965 tablet_loader.cc:96] loaded metadata for tablet 3287d6029a09458da24e65c4d802eb92 (table default.Table_087f134702a64647bd34ce9f69e750e8 [id=3cdc318caab3417a9c47ffa7846ada47])
I20260807 11:09:08.685570 25563 raft_consensus.cc:2781] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:08.697813 25563 raft_consensus.cc:686] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:08.698570 25563 consensus_queue.cc:237] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.702592 24965 tablet_loader.cc:96] loaded metadata for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212])
I20260807 11:09:08.705799 24965 tablet_loader.cc:96] loaded metadata for tablet 39efd13118454aa983918238928ef2bc (table default.Table_8522529a488848f3b03e73129ea0d266 [id=83176283c5544d0198bd1d0e3d25bf9a])
I20260807 11:09:08.716305 24965 tablet_loader.cc:96] loaded metadata for tablet 4b001bc080a14838a3fc58af982b792b (table default.Table_79d4708c11e142898ac8f110ae900110 [id=1a0da9749dcd4d62bb6fbd71118d5e67])
I20260807 11:09:08.718086 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7aa352ec3434afb81933c3151c3742d" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:08.724960 24965 tablet_loader.cc:96] loaded metadata for tablet 4c7574a78a6546b6bf3d51635773b693 (table default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f])
I20260807 11:09:08.731930 24266 tablet_bootstrap.cc:492] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:08.733565 25582 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:09:08.734818 24681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:09:08.736666 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12bb5a459df41e0b0eb87534cb5959a" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:08.736965 24266 tablet_bootstrap.cc:654] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:08.745198 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:08.746089 24965 tablet_loader.cc:96] loaded metadata for tablet 4c7d0cab3da641f4abca60a8beff381e (table default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e])
I20260807 11:09:08.747946 24965 tablet_loader.cc:96] loaded metadata for tablet 4e965a1dc66c414285df6727d2982e12 (table default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d])
I20260807 11:09:08.749713 24965 tablet_loader.cc:96] loaded metadata for tablet 52e6dc2403c149e68985595e5e137dfa (table default.Table_f7407267f0e140289ed791ad730d154f [id=b132fefb831d4870aaddeee3f8e1479f])
I20260807 11:09:08.754992 24266 tablet_bootstrap.cc:492] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:08.756306 24057 raft_consensus.cc:3037] T 6a427e865f1c4d938483a8222a95307e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.756860 24266 ts_tablet_manager.cc:1397] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.000s
I20260807 11:09:08.759230 24266 raft_consensus.cc:348] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:08.762420 24266 raft_consensus.cc:374] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:08.762677 24266 raft_consensus.cc:729] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:08.769055 24266 consensus_queue.cc:260] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:08.774685 24266 ts_tablet_manager.cc:1428] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260807 11:09:08.775491 24266 tablet_bootstrap.cc:492] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:08.781644 24965 tablet_loader.cc:96] loaded metadata for tablet 5b0bf5fcaf764e189506b883d7ba3111 (table default.Table_df4c28e5effb4b60b90f040c46268eb7 [id=5920b1c2aacd403cac2ce78b06a57482])
I20260807 11:09:08.787550 23954 leader_election.cc:302] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:08.788524 25537 raft_consensus.cc:2726] T e7aa352ec3434afb81933c3151c3742d P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:08.778661 24261 tablet_bootstrap.cc:492] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:08.789687 24261 ts_tablet_manager.cc:1397] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.286s user 0.010s sys 0.000s
I20260807 11:09:08.792291 24261 raft_consensus.cc:348] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.793124 24965 tablet_loader.cc:96] loaded metadata for tablet 5e0eeeeb7c73470f97bc76566b21e522 (table default.Table_9cc5f868b933436a9237ac18b3aaa690 [id=4b999790160a48d09074af28ebd16079])
I20260807 11:09:08.793166 24261 raft_consensus.cc:374] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:08.794410 24261 raft_consensus.cc:729] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:08.804880 24965 tablet_loader.cc:96] loaded metadata for tablet 5f41042d50184ecf9bbd2c225c86aabf (table default.Table_b226b03cf22c4dbf9a1be5ec1499a367 [id=00a5f697df75490eaed389c034050304])
I20260807 11:09:08.808817 24266 tablet_bootstrap.cc:654] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:08.824985 23954 leader_election.cc:341] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 6ce7963b93094c27b9e25308e68be630
I20260807 11:09:08.825405 23954 leader_election.cc:302] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:08.826239 25439 raft_consensus.cc:2726] T 6ce7963b93094c27b9e25308e68be630 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:08.834798 24965 tablet_loader.cc:96] loaded metadata for tablet 64c4a0700315457384e3ca995de8a4f2 (table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63])
I20260807 11:09:08.845108 23954 leader_election.cc:302] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:08.845878 25537 raft_consensus.cc:2726] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:08.855166 25537 raft_consensus.cc:482] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.855603 25537 raft_consensus.cc:504] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.857950 25537 leader_election.cc:288] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:08.859974 23951 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 8a2df15b35bd435baaf95a708ec85a37
W20260807 11:09:08.881421 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 67393.9us
I20260807 11:09:08.895201 24052 raft_consensus.cc:3037] T c12bb5a459df41e0b0eb87534cb5959a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:08.908183 25495 consensus_queue.cc:1035] T c12bb5a459df41e0b0eb87534cb5959a P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:08.909389 24266 tablet_bootstrap.cc:492] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:08.909847 24266 ts_tablet_manager.cc:1397] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.135s user 0.010s sys 0.000s
I20260807 11:09:08.912168 24266 raft_consensus.cc:348] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:08.911587 25334 consensus_queue.cc:1035] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:08.915975 25523 raft_consensus.cc:482] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.919319 25523 raft_consensus.cc:504] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:08.920984 24965 tablet_loader.cc:96] loaded metadata for tablet 6a427e865f1c4d938483a8222a95307e (table default.Table_0734c6da9f9e477098985611bb0b0f13 [id=fc33a561f61b4f9bb49fbaef2438b00e])
I20260807 11:09:08.921083 25523 leader_election.cc:288] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.923270 24965 tablet_loader.cc:96] loaded metadata for tablet 6a92aa4664c54114a8816710820e3864 (table default.Table_1ba07f688e5f42a18c6985eaf65e16e1 [id=282f43d738714393ba1c23189d039355])
I20260807 11:09:08.925175 24965 tablet_loader.cc:96] loaded metadata for tablet 6fde3f237aa54f24b955c4244224a6ea (table default.Table_07911aa3b4c244118be60ebcc25a777a [id=e2e06aca451241a2b4d4c84ccabfc1fc])
W20260807 11:09:08.930410 23510 leader_election.cc:341] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:08.918427 24261 consensus_queue.cc:260] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:08.931231 23510 leader_election.cc:341] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:08.936403 23510 leader_election.cc:341] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:08.934470 24261 ts_tablet_manager.cc:1428] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.144s user 0.005s sys 0.000s
I20260807 11:09:08.938395 24261 tablet_bootstrap.cc:492] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:08.940129 24266 raft_consensus.cc:374] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:08.943154 24266 raft_consensus.cc:729] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:08.946295 24266 consensus_queue.cc:260] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:08.964773 25514 consensus_queue.cc:1035] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:08.967376 24965 tablet_loader.cc:96] loaded metadata for tablet 738da1d000b4434cb194d91fea4cc6a5 (table default.Table_0e986c6a79d84a98b7351ebc3eac6415 [id=ba93341a8c3e469a93965e872dcf7686])
W20260807 11:09:08.968775 23510 leader_election.cc:341] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:08.969617 23510 consensus_peers.cc:487] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:08.971761 24266 ts_tablet_manager.cc:1428] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.062s user 0.005s sys 0.000s
W20260807 11:09:08.974685 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 63492us
I20260807 11:09:08.975703 25574 consensus_queue.cc:1035] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:08.980062 24965 tablet_loader.cc:96] loaded metadata for tablet 741fdb38a64c4e63a6efc447c6f5ca1f (table default.Table_6f8c96453d0f4d3f8465677953583882 [id=9e5c74477bb5499fa65ebac48712d2a3])
I20260807 11:09:08.980886 25537 raft_consensus.cc:482] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:08.981550 25537 raft_consensus.cc:504] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:08.984050 25537 leader_election.cc:288] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:08.985822 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:08.986179 24261 tablet_bootstrap.cc:654] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:08.988425 24266 tablet_bootstrap.cc:492] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:09.007707 23607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b001bc080a14838a3fc58af982b792b" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:09.020147 23954 leader_election.cc:341] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 8a2df15b35bd435baaf95a708ec85a37
I20260807 11:09:09.020550 23954 leader_election.cc:302] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:09.022663 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:09.023475 25537 raft_consensus.cc:2726] T 8a2df15b35bd435baaf95a708ec85a37 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:09.029417 24965 tablet_loader.cc:96] loaded metadata for tablet 88a7cbb316e24dd68127b7e13ad6ae68 (table default.Table_57207993c2f443c6841b0228be8fe9b3 [id=a847486f994d4eaab42a77a907556f6d])
I20260807 11:09:09.029865 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:09.030485 23844 raft_consensus.cc:2454] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:09.030638 24965 tablet_loader.cc:96] loaded metadata for tablet 88e76082d4094493a544e18ce9594e20 (table default.Table_94e16611ae8443e08052b5dc61520b02 [id=b7905a38d56448c8b4047f8ec0b6d9f4])
I20260807 11:09:09.002300 25602 consensus_queue.cc:1035] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260807 11:09:09.045469 23507 leader_election.cc:302] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:09.046303 25563 raft_consensus.cc:2781] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:09.046772 25563 raft_consensus.cc:482] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:09.047272 25563 raft_consensus.cc:3037] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.049973 24965 tablet_loader.cc:96] loaded metadata for tablet 907f602c4dce41389e06307270c16f71 (table default.Table_e4383b988f6941c9be5c4bbcc5425e76 [id=852d1ec4b63747218187fba2c75f2b87])
I20260807 11:09:09.051162 24965 tablet_loader.cc:96] loaded metadata for tablet 912026edd2664386880028a5958a993c (table default.Table_0e391a540a1f4eb09798376daa1dd533 [id=01bc2a49d75f4d11bbbb6a644e2498b3])
I20260807 11:09:09.061045 25421 consensus_queue.cc:1035] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:09.063536 23954 leader_election.cc:302] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:09.067986 25537 raft_consensus.cc:2726] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:09.077744 25495 raft_consensus.cc:482] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.078384 24261 tablet_bootstrap.cc:492] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:09.078217 25495 raft_consensus.cc:504] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.078766 24261 ts_tablet_manager.cc:1397] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.003s
I20260807 11:09:09.080631 25495 leader_election.cc:288] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:09.081825 23510 leader_election.cc:341] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.082835 23608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:09.083299 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:09.084287 23745 leader_election.cc:341] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:09.084928 23745 leader_election.cc:341] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.085201 23745 leader_election.cc:302] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:09.091300 25495 raft_consensus.cc:2726] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:09.086661 24965 tablet_loader.cc:96] loaded metadata for tablet 94fa4bb0de684c50bcba33519866e583 (table default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9])
I20260807 11:09:09.105762 24965 tablet_loader.cc:96] loaded metadata for tablet 95fc220a912543eb8f43d6379795ca03 (table default.Table_6142de128f694ccfb31fcbde5ffd7d94 [id=df7d6690afb347e890c89bbb8cbd8875])
I20260807 11:09:09.112947 24965 tablet_loader.cc:96] loaded metadata for tablet 9c4f1adf1fb9450cba3de70397beaa2b (table default.Table_bd4ad9fadca04c0eaa62bf1d0f63e8cb [id=53967af96c72486f9aaa26abffa6fbfa])
I20260807 11:09:09.114115 24965 tablet_loader.cc:96] loaded metadata for tablet 9cd1107ba80a4dbeaba696a7b7095423 (table default.Table_a6db15451abd4a1ca32ce8f2c440b936 [id=9e28a60150c04136b617507a6af99466])
I20260807 11:09:09.127125 24965 tablet_loader.cc:96] loaded metadata for tablet a20f0ba778a14d71b9e5efa113c784ff (table default.Table_3d3d2c64ef784197815a34510666c5df [id=91a12abc12694046b152c42fedd52521])
I20260807 11:09:09.128635 24261 raft_consensus.cc:348] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.129350 24261 raft_consensus.cc:374] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:09.129603 24261 raft_consensus.cc:729] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:09.130192 24261 consensus_queue.cc:260] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.137029 25563 raft_consensus.cc:504] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.112593 24266 tablet_bootstrap.cc:654] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:09.161031 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:09.161648 23844 raft_consensus.cc:3037] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.163985 24965 tablet_loader.cc:96] loaded metadata for tablet a65c860297d2421b9c1d0e31497a77af (table default.Table_94689d0c00964dc88800aa0602ac5f73 [id=aa1b402a6ff34987b35696530cf94e5a])
I20260807 11:09:09.165778 24965 tablet_loader.cc:96] loaded metadata for tablet a7afaa7606884464aa8b376513a466f2 (table default.Table_8aada9f80c114120b9fad92d59976579 [id=86a60d2c4fed45f8b7c1c15ea61847f8])
I20260807 11:09:09.166697 24965 tablet_loader.cc:96] loaded metadata for tablet acae47d486e645afa2e42323864fa370 (table default.Table_3ad860f1514e47d9951f2ca82b21044f [id=e97c2a634a534b23a3ffd3699c86a28b])
I20260807 11:09:09.167810 24965 tablet_loader.cc:96] loaded metadata for tablet aea90f7a10234f2da4fff089afe87a1e (table default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3])
I20260807 11:09:09.168506 23844 raft_consensus.cc:2454] T af30e8f4acfb48db875017c1db21f433 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:09.169466 23507 leader_election.cc:302] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:09.171243 25514 raft_consensus.cc:2781] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:09.171708 25514 raft_consensus.cc:686] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:09.170797 25563 leader_election.cc:288] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:09.172498 25514 consensus_queue.cc:237] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.173071 24261 ts_tablet_manager.cc:1428] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.094s user 0.006s sys 0.000s
I20260807 11:09:09.173991 24261 tablet_bootstrap.cc:492] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:09.203266 25495 raft_consensus.cc:482] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.203728 25495 raft_consensus.cc:504] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.205574 25495 leader_election.cc:288] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:09.207060 23607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:09.208717 23745 leader_election.cc:341] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.221643 24041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:09.222488 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:09.224776 23745 leader_election.cc:341] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.225136 23745 leader_election.cc:302] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:09.227053 25597 raft_consensus.cc:2726] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:09.239508 24051 raft_consensus.cc:3037] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.240408 24965 tablet_loader.cc:96] loaded metadata for tablet af30e8f4acfb48db875017c1db21f433 (table default.Table_9b7a6afec0d2423ea15d59b70e646e8d [id=9d1d8cf406384f4291a4f52655394cf0])
I20260807 11:09:09.243731 24965 tablet_loader.cc:96] loaded metadata for tablet b0ee41a2c21548e7961b3884e8c7a4ff (table default.Table_8c7e5e4c285b42d7b553c1939691168d [id=e14499712b28410b8d9a1e8335b5da46])
I20260807 11:09:09.246104 24965 tablet_loader.cc:96] loaded metadata for tablet b53e85597f6e44f08e3076d2622d44c3 (table default.Table_68575b95a3f045c989a91bff8785baed [id=efebaf241d40428db31da62407816203])
I20260807 11:09:09.211881 25610 raft_consensus.cc:482] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.247347 25610 raft_consensus.cc:504] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.251525 24965 tablet_loader.cc:96] loaded metadata for tablet b62eea967fed4adc84252b8366609878 (table default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06])
I20260807 11:09:09.254642 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:09.260865 25610 leader_election.cc:288] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:09.292479 25230 raft_consensus.cc:482] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.292927 25230 raft_consensus.cc:504] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:09.296232 25230 leader_election.cc:288] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:09.297263 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:09:09.299830 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 83721us
I20260807 11:09:09.301214 25495 raft_consensus.cc:482] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.301648 25495 raft_consensus.cc:504] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.303452 25495 leader_election.cc:288] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:09.305951 23607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:09.306371 24261 tablet_bootstrap.cc:654] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:09.306548 23607 raft_consensus.cc:2454] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:09:09.307709 23745 leader_election.cc:302] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:09.308548 25495 raft_consensus.cc:2781] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:09.308853 25495 raft_consensus.cc:482] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:09.309122 25495 raft_consensus.cc:3037] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:09.314990 23510 leader_election.cc:341] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.319573 25495 raft_consensus.cc:504] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.326351 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:09.326830 24965 tablet_loader.cc:96] loaded metadata for tablet c5dfdf237bab4aefbd1a45325d741cf5 (table default.Table_3296c53524e341ea9bd1f69a41aec0c4 [id=00906552217a443386552aeb9a487abd])
W20260807 11:09:09.327634 23745 leader_election.cc:341] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.328141 25495 leader_election.cc:288] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:09.330487 24965 tablet_loader.cc:96] loaded metadata for tablet cc36c0c8fded4ac6991b98c132b17e56 (table default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484])
I20260807 11:09:09.332414 24965 tablet_loader.cc:96] loaded metadata for tablet cc48c13644a3401ab34dad398a7f5cd5 (table default.Table_372fb4dfd7964080bdf92a9b3fe8f1ee [id=3955ad62f1cb4748a05ac3bda8c98a22])
I20260807 11:09:09.334424 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:09.335347 23608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26e0c103c9724de18cf95897f33a101a" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:09.338461 23607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a92aa4664c54114a8816710820e3864" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:09.340477 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:09.341205 23610 raft_consensus.cc:3037] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.350035 25602 consensus_queue.cc:1035] T 26e0c103c9724de18cf95897f33a101a P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:09.355322 23954 leader_election.cc:302] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:09.360635 24266 tablet_bootstrap.cc:492] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:09.361168 24266 ts_tablet_manager.cc:1397] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.373s user 0.012s sys 0.000s
I20260807 11:09:09.364073 24266 raft_consensus.cc:348] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.375450 25537 raft_consensus.cc:2726] T 26e0c103c9724de18cf95897f33a101a P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:09:09.337317 23745 leader_election.cc:341] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:09.379750 25622 log.cc:924] Time spent T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93: Append to log took a long time: real 0.132s user 0.001s sys 0.000s
I20260807 11:09:09.361100 24037 raft_consensus.cc:3037] T 4b001bc080a14838a3fc58af982b792b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.364727 24266 raft_consensus.cc:374] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:09.387143 24266 raft_consensus.cc:729] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:09.387744 24266 consensus_queue.cc:260] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.401212 23954 leader_election.cc:302] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:09.420318 23610 raft_consensus.cc:2454] T c5dfdf237bab4aefbd1a45325d741cf5 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:09:09.433521 23745 leader_election.cc:302] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:09.434531 25495 raft_consensus.cc:2781] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:09.435011 25495 raft_consensus.cc:686] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:09:09.435793 25495 consensus_queue.cc:237] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.334827 24965 tablet_loader.cc:96] loaded metadata for tablet cc7d0d889f2541a9a5c3c45f1c39df06 (table default.Table_d9bd2b2348cb4614a4bd7c207186a696 [id=97fa5c597042473aac2865ebebf63541])
I20260807 11:09:09.418467 25610 raft_consensus.cc:2726] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:09.446599 24052 raft_consensus.cc:3037] T 6a92aa4664c54114a8816710820e3864 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.449591 24965 tablet_loader.cc:96] loaded metadata for tablet cdd1a829d01c41f28a54cf4e3d9c3099 (table default.Table_9a56149cf3194cdf95b9d8ebb7565aee [id=0c35da9831c64205922aa00f91d5b80d])
I20260807 11:09:09.453022 24261 tablet_bootstrap.cc:492] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:09.453446 24261 ts_tablet_manager.cc:1397] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.280s user 0.011s sys 0.000s
I20260807 11:09:09.453514 24965 tablet_loader.cc:96] loaded metadata for tablet cef5bc28dada49bdada085e87d1f0dab (table default.Table_f343bd15113d474ba791135714036936 [id=3a6709ec839444279264e56e47b6a0d7])
I20260807 11:09:09.459208 24965 tablet_loader.cc:96] loaded metadata for tablet d2994bc5a5b74f40bf0c8a60644f2c25 (table default.Table_81cea7b24eb8462093613254c16693bd [id=0f68d2c639d546d3ac76d6536949e2f5])
I20260807 11:09:09.460894 24965 tablet_loader.cc:96] loaded metadata for tablet d3011806841f46f898920b1a11404f85 (table default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb])
I20260807 11:09:09.464020 24965 tablet_loader.cc:96] loaded metadata for tablet d6ec7dbecd7a4fb0a0da16e00df84d22 (table default.Table_c3b1895765b44a4eae9efabea2a2e456 [id=d234e8cf6d8546639f2c3420c16b9cac])
I20260807 11:09:09.456353 24261 raft_consensus.cc:348] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.482462 24261 raft_consensus.cc:374] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:09.482743 24261 raft_consensus.cc:729] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:09.483421 24261 consensus_queue.cc:260] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.494218 24058 raft_consensus.cc:3037] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.516301 25421 consensus_queue.cc:1035] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:09.525393 24266 ts_tablet_manager.cc:1428] T 11c31c37cb2a4d1d8396a79de7d2493c P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.164s user 0.004s sys 0.002s
I20260807 11:09:09.535029 25339 consensus_queue.cc:1035] T 11c31c37cb2a4d1d8396a79de7d2493c P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:09.544178 25339 raft_consensus.cc:482] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.544680 25339 raft_consensus.cc:504] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.546932 25339 leader_election.cc:288] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:09.548082 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3011806841f46f898920b1a11404f85" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:09.548734 23837 raft_consensus.cc:2454] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:09.549861 23507 leader_election.cc:302] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:09.550981 25514 raft_consensus.cc:2781] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:09.551304 25514 raft_consensus.cc:482] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:09.552513 25514 raft_consensus.cc:3037] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.486192 24261 ts_tablet_manager.cc:1428] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
I20260807 11:09:09.565205 25514 raft_consensus.cc:504] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.575718 25514 leader_election.cc:288] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:09.575894 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3011806841f46f898920b1a11404f85" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:09.576443 23846 raft_consensus.cc:3037] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.548502 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3011806841f46f898920b1a11404f85" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:09.584192 23510 leader_election.cc:341] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.586136 24965 tablet_loader.cc:96] loaded metadata for tablet da4a85755e5a4f53ba2d785020b0a8e2 (table default.Table_30b02767d83b41a48e58f46544825d48 [id=4e04c93b9a4c4ce988f22fbe3a021742])
I20260807 11:09:09.587505 24965 tablet_loader.cc:96] loaded metadata for tablet da7c92ce240b4bbf8aa2457e5ec0ccb0 (table default.Table_2cbdc073cd0242d9ba358f06215755d3 [id=03bf1751e8404c34a38d083358a153a1])
I20260807 11:09:09.598515 24261 tablet_bootstrap.cc:492] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:09.599771 24965 tablet_loader.cc:96] loaded metadata for tablet dde5287f17a944708d7678c57bf37bf9 (table default.Table_a46f408876e040f7abc059e728d04a9c [id=d8165adfe8ce4053b5b35900f89cd0de])
I20260807 11:09:09.608095 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3011806841f46f898920b1a11404f85" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:09.613200 23510 consensus_peers.cc:487] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:09.614813 23510 leader_election.cc:341] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.616112 24266 tablet_bootstrap.cc:492] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:09.628018 23846 raft_consensus.cc:2454] T d3011806841f46f898920b1a11404f85 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:09.629776 23507 leader_election.cc:302] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:09.631055 25563 raft_consensus.cc:2781] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:09.631488 25563 raft_consensus.cc:686] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:09.633224 25563 consensus_queue.cc:237] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.665210 24261 tablet_bootstrap.cc:654] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:09.691126 25495 raft_consensus.cc:482] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.691627 25495 raft_consensus.cc:504] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.693619 25495 leader_election.cc:288] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:09.695717 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:09.699204 23745 leader_election.cc:341] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.727437 25563 raft_consensus.cc:482] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.727900 25563 raft_consensus.cc:504] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.730039 25563 leader_election.cc:288] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:09.727231 24261 tablet_bootstrap.cc:492] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:09.731287 24965 tablet_loader.cc:96] loaded metadata for tablet e5685972a6dd45a3806f7a096bffd492 (table default.Table_89376166cd0b4be1ad5e90c84f809333 [id=44552a1ef4ac4136a8d4907501fc03ad])
I20260807 11:09:09.731524 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da4a85755e5a4f53ba2d785020b0a8e2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:09.732121 23844 raft_consensus.cc:2454] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:09.733618 23507 leader_election.cc:302] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:09.735148 25563 raft_consensus.cc:2781] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:09.735446 25563 raft_consensus.cc:482] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:09.735749 25563 raft_consensus.cc:3037] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:09.735066 24261 ts_tablet_manager.cc:1397] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.173s user 0.018s sys 0.001s
I20260807 11:09:09.739810 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da4a85755e5a4f53ba2d785020b0a8e2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:09.741961 24037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:09.743204 23507 consensus_peers.cc:487] T 2ac76be04eca4d7d9d7f0cf6956fd56a P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ac76be04eca4d7d9d7f0cf6956fd56a. This is attempt 6: this message will repeat every 5th retry.
W20260807 11:09:09.744272 23745 leader_election.cc:341] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.744632 23745 leader_election.cc:302] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:09.745328 25495 raft_consensus.cc:2726] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:09.753832 23510 leader_election.cc:341] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.759346 24266 tablet_bootstrap.cc:654] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:09.766443 24965 tablet_loader.cc:96] loaded metadata for tablet e7aa352ec3434afb81933c3151c3742d (table default.Table_c8e7c102b5df4cc6ac8958d6250ef4e6 [id=81710632f4754a50bbf43e0cd8d80296])
I20260807 11:09:09.771009 24965 tablet_loader.cc:96] loaded metadata for tablet eb6981fd8c9d4d4d8606fc73f7a01d0b (table default.Table_b691ab49ae6a48d4827f493634dc62e7 [id=18d7876a6bec428f8d44a9d68269539a])
I20260807 11:09:09.770666 25334 consensus_queue.cc:1035] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:09.784380 25563 raft_consensus.cc:504] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.787343 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da4a85755e5a4f53ba2d785020b0a8e2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:09.787547 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da4a85755e5a4f53ba2d785020b0a8e2" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:09.788035 23844 raft_consensus.cc:3037] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:09.788718 23510 leader_election.cc:341] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.793443 24965 tablet_loader.cc:96] loaded metadata for tablet ed5973e2e1b043dbb896d8461a423cae (table default.Table_308433d482ea452289ce2b3d63e5577d [id=93f43cefc3d74c9190ae50d66bcfb3ba])
I20260807 11:09:09.798280 24965 tablet_loader.cc:96] loaded metadata for tablet ed62b70f86f3457ab0315ff25e836ec6 (table default.Table_fbc2eeb603af4b3a84797af4a00deb52 [id=9fe3f76ee52549269d443fb394b22540])
I20260807 11:09:09.799695 25421 consensus_queue.cc:1035] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:09.802816 24965 tablet_loader.cc:96] loaded metadata for tablet f3647d1473454c9ca1c8c2d3441586a2 (table default.Table_bcbbbb7ddd0840a7b45baef6133d5808 [id=251656231af64a1b9a66dbbd7f962071])
I20260807 11:09:09.816166 24965 tablet_loader.cc:96] loaded metadata for tablet f36b812880814298990c9aee6999f113 (table default.Table_3e30bbe8a73348c2a9af2b1e51fbe2f5 [id=9e5c4d1a3cc44af8a5067e542f7a4445])
I20260807 11:09:09.820151 23844 raft_consensus.cc:2454] T da4a85755e5a4f53ba2d785020b0a8e2 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:09.821051 23507 leader_election.cc:302] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:09.825515 25495 raft_consensus.cc:482] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:09.826009 25495 raft_consensus.cc:504] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.828107 24965 tablet_loader.cc:96] loaded metadata for tablet f8bab6e4fca343ffb1dc8d3da6c0b244 (table default.Table_6d0d642c3b424c3388505b3ba6a6bb25 [id=6684170bb34949e7a0a3e10216b490bf])
I20260807 11:09:09.828454 25495 leader_election.cc:288] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:09.828604 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:09.829146 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:09.829857 23745 leader_election.cc:341] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:09.830737 23745 leader_election.cc:341] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:09.831101 23745 leader_election.cc:302] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:09.831986 25495 raft_consensus.cc:2726] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:09.833248 25334 raft_consensus.cc:2781] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:09.833714 25334 raft_consensus.cc:686] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:09.834921 25334 consensus_queue.cc:237] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:09.844720 23510 consensus_peers.cc:487] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:09.904821 25563 leader_election.cc:288] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:09.916373 23142 leader_election.cc:334] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237): Timed out: RequestConsensusVote RPC to 127.22.115.254:40237 timed out after 0.622s (SENT)
I20260807 11:09:09.916775 23142 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:09.917498 24261 raft_consensus.cc:348] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.919355 24261 raft_consensus.cc:374] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:09.964485 24261 raft_consensus.cc:729] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:09.965126 24261 consensus_queue.cc:260] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.968230 24266 tablet_bootstrap.cc:492] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:09.969924 24266 ts_tablet_manager.cc:1397] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.354s user 0.003s sys 0.015s
I20260807 11:09:09.971567 24965 tablet_loader.cc:96] loaded metadata for tablet fb1504be4320471687d86a55a9891081 (table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5])
I20260807 11:09:09.988066 24266 raft_consensus.cc:348] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:09.988734 24266 raft_consensus.cc:374] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:09.988988 24266 raft_consensus.cc:729] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:09.991093 24266 consensus_queue.cc:260] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.008493 25662 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:10.009081 24261 ts_tablet_manager.cc:1428] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.256s user 0.008s sys 0.004s
I20260807 11:09:10.009992 24261 tablet_bootstrap.cc:492] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:09:10.010527 23142 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.254:40237, user_credentials={real_user=slave}} blocked reactor thread for 94192.1us
I20260807 11:09:10.014559 24261 tablet_bootstrap.cc:654] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.008205 24266 ts_tablet_manager.cc:1428] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.038s user 0.005s sys 0.000s
I20260807 11:09:10.017014 24266 tablet_bootstrap.cc:492] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:10.050164 25652 raft_consensus.cc:482] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.050678 25652 raft_consensus.cc:504] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.052604 25652 leader_election.cc:288] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:10.054919 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:10.056121 23745 leader_election.cc:341] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.056342 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:10.058300 23745 leader_election.cc:341] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.058640 23745 leader_election.cc:302] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:10.061127 25652 raft_consensus.cc:2726] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:10.067589 25514 raft_consensus.cc:482] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.068069 25514 raft_consensus.cc:504] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.070647 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:10.071902 23510 leader_election.cc:341] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.072731 25514 leader_election.cc:288] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:10.074012 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:10.074568 23844 raft_consensus.cc:2454] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:10.075613 23507 leader_election.cc:302] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:10.090312 24266 tablet_bootstrap.cc:654] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.090883 25339 raft_consensus.cc:2781] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:10.091308 25339 raft_consensus.cc:482] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:10.091688 25339 raft_consensus.cc:3037] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.105683 24266 tablet_bootstrap.cc:492] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:10.106231 24266 ts_tablet_manager.cc:1397] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.089s user 0.007s sys 0.003s
I20260807 11:09:10.109088 24266 raft_consensus.cc:348] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.109721 24266 raft_consensus.cc:374] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:10.109961 24266 raft_consensus.cc:729] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:10.121145 25339 raft_consensus.cc:504] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.137960 24266 consensus_queue.cc:260] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.145393 24266 ts_tablet_manager.cc:1428] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.039s user 0.002s sys 0.005s
I20260807 11:09:10.147495 24266 tablet_bootstrap.cc:492] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:10.159761 24261 tablet_bootstrap.cc:492] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:10.160179 24261 ts_tablet_manager.cc:1397] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.150s user 0.006s sys 0.002s
I20260807 11:09:10.162535 24261 raft_consensus.cc:348] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.191665 24261 raft_consensus.cc:374] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:10.191973 24261 raft_consensus.cc:729] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:10.192545 24261 consensus_queue.cc:260] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.194043 24261 ts_tablet_manager.cc:1428] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.034s user 0.002s sys 0.002s
I20260807 11:09:10.195966 24052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:10.197243 23510 leader_election.cc:341] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.199651 25652 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a668588fabb4a9eba107cd6020f1e93)
I20260807 11:09:10.200177 25652 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.202147 25652 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:10.202693 23510 consensus_peers.cc:487] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:10.204587 24037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:10.205330 24037 raft_consensus.cc:2379] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99a8d4e2c1b14150b03ad0f28e74a011 in current term 2: Already voted for candidate c281254655c84a0496c50045c37b22df in this term.
I20260807 11:09:10.207108 24266 tablet_bootstrap.cc:654] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.207058 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:10.207675 23610 raft_consensus.cc:2454] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 2.
I20260807 11:09:10.208662 23745 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:10.209549 25652 raft_consensus.cc:2781] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 11:09:10.209895 25652 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8a668588fabb4a9eba107cd6020f1e93)
I20260807 11:09:10.210237 25652 raft_consensus.cc:3037] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Advancing to term 2
I20260807 11:09:10.211766 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:10.212275 23844 raft_consensus.cc:3037] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.217542 25652 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.218066 23844 raft_consensus.cc:2454] T 4c7d0cab3da641f4abca60a8beff381e P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:10.219525 23507 leader_election.cc:302] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:10.221215 25664 raft_consensus.cc:2781] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:10.221701 25664 raft_consensus.cc:686] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:10.239189 24261 tablet_bootstrap.cc:492] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:10.246459 24037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:10.247296 24037 raft_consensus.cc:2379] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 99a8d4e2c1b14150b03ad0f28e74a011 in current term 2: Already voted for candidate c281254655c84a0496c50045c37b22df in this term.
I20260807 11:09:10.247459 25652 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:10.248958 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:10.256652 23610 raft_consensus.cc:2454] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 2.
I20260807 11:09:10.257952 23745 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:10.260553 25652 raft_consensus.cc:2781] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 11:09:10.261534 25652 raft_consensus.cc:686] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 2 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:09:10.262404 25652 consensus_queue.cc:237] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.236011 25664 consensus_queue.cc:237] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.275622 24261 tablet_bootstrap.cc:654] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.308382 25339 leader_election.cc:288] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:10.323825 24965 catalog_manager.cc:1476] Time spent T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Loading table and tablet metadata into memory: real 11.796s user 0.249s sys 0.091s
I20260807 11:09:10.325428 24965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 11:09:10.325212 23057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:09:10.326300 23057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 20) took 8034 ms (client timeout 626 ms). Trace:
I20260807 11:09:10.327183 23059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:09:10.328212 23059 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51742 (request call id 4) took 8481 ms (client timeout 591 ms). Trace:
W20260807 11:09:10.328526 23059 rpcz_store.cc:269] 0807 11:09:01.846869 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:01.850630 (+ 3761us) service_pool.cc:227] Handling call
0807 11:09:10.328102 (+8477472us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 11:09:10.329571 23059 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51742 (request call id 7) took 4742 ms (client timeout 605 ms). Trace:
W20260807 11:09:10.329876 23059 rpcz_store.cc:269] 0807 11:09:05.586987 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:10.329363 (+4742376us) service_pool.cc:214] Skipping call since client already timed out
0807 11:09:10.329512 (+ 149us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 11:09:10.331202 23060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:09:10.332083 23060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51742 (request call id 3) took 9110 ms (client timeout 591 ms). Trace:
W20260807 11:09:10.332427 23060 rpcz_store.cc:269] 0807 11:09:01.221590 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:01.221987 (+ 397us) service_pool.cc:227] Handling call
0807 11:09:10.332015 (+9110028us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 11:09:10.333276 23060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 24) took 3725 ms (client timeout 614 ms). Trace:
W20260807 11:09:10.333590 23060 rpcz_store.cc:269] 0807 11:09:06.607539 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:10.333109 (+3725570us) service_pool.cc:214] Skipping call since client already timed out
0807 11:09:10.333228 (+ 119us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 11:09:10.334347 23060 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 25) took 3052 ms (client timeout 614 ms). Trace:
I20260807 11:09:10.324127 23056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:09:10.335470 23062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:09:10.351874 24052 raft_consensus.cc:3037] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.364617 24261 tablet_bootstrap.cc:492] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:10.365033 24261 ts_tablet_manager.cc:1397] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.158s user 0.005s sys 0.010s
I20260807 11:09:10.367277 24266 tablet_bootstrap.cc:492] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:10.367770 24266 ts_tablet_manager.cc:1397] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.220s user 0.001s sys 0.018s
I20260807 11:09:10.367595 24261 raft_consensus.cc:348] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.368251 24261 raft_consensus.cc:374] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:10.368512 24261 raft_consensus.cc:729] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:10.369102 24261 consensus_queue.cc:260] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:10.393172 23062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 19) took 10299 ms (client timeout 714 ms). Trace:
W20260807 11:09:10.393574 23062 rpcz_store.cc:269] 0807 11:09:00.093389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:00.093976 (+ 587us) service_pool.cc:227] Handling call
0807 11:09:10.393069 (+10299093us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 11:09:10.394556 23062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 26) took 1751 ms (client timeout 622 ms). Trace:
W20260807 11:09:10.394960 23062 rpcz_store.cc:269] 0807 11:09:08.642928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:10.394365 (+1751437us) service_pool.cc:214] Skipping call since client already timed out
0807 11:09:10.394501 (+ 136us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 11:09:10.395736 23062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 27) took 1101 ms (client timeout 622 ms). Trace:
W20260807 11:09:10.396109 23062 rpcz_store.cc:269] 0807 11:09:09.293920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:10.395592 (+1101672us) service_pool.cc:214] Skipping call since client already timed out
0807 11:09:10.395690 (+ 98us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 11:09:10.396945 23065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:09:10.397791 23065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 18) took 11087 ms (client timeout 714 ms). Trace:
W20260807 11:09:10.398098 23065 rpcz_store.cc:269] 0807 11:08:59.310225 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:59.310372 (+ 147us) service_pool.cc:227] Handling call
0807 11:09:10.397724 (+11087352us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:10.399161 25339 raft_consensus.cc:482] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.399396 23043 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:53338 (request call id 281) took 11811 ms. Trace:
I20260807 11:09:10.399752 23043 rpcz_store.cc:276] 0807 11:08:58.587814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:08:58.588809 (+ 995us) service_pool.cc:227] Handling call
0807 11:09:10.399085 (+11810276us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:10.399642 25339 raft_consensus.cc:504] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.400177 24261 ts_tablet_manager.cc:1428] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
I20260807 11:09:10.401440 25339 leader_election.cc:288] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:10.404104 24037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:10.408233 23510 leader_election.cc:341] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.410166 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:10.410696 23844 raft_consensus.cc:2454] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:10.414443 23507 leader_election.cc:302] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:10.415583 25574 raft_consensus.cc:2781] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:10.415885 25574 raft_consensus.cc:482] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:10.416198 25574 raft_consensus.cc:3037] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.419411 25339 consensus_queue.cc:1035] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 11:09:10.330654 23059 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51742 (request call id 8) took 3969 ms (client timeout 605 ms). Trace:
W20260807 11:09:10.423293 23056 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 21) took 7402 ms (client timeout 626 ms). Trace:
W20260807 11:09:10.423709 23056 rpcz_store.cc:269] 0807 11:09:03.020669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:03.020911 (+ 242us) service_pool.cc:227] Handling call
0807 11:09:10.423208 (+7402297us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 11:09:10.326668 23057 rpcz_store.cc:269] 0807 11:09:02.292284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:02.292513 (+ 229us) service_pool.cc:227] Handling call
0807 11:09:10.326195 (+8033682us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:10.421334 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:09:10.431838 23053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:09:10.433444 23053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 22) took 6009 ms (client timeout 740 ms). Trace:
W20260807 11:09:10.433808 23053 rpcz_store.cc:269] 0807 11:09:04.424432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:04.424629 (+ 197us) service_pool.cc:227] Handling call
0807 11:09:10.433369 (+6008740us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:10.435179 23054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:09:10.436650 23054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51742 (request call id 6) took 6199 ms (client timeout 649 ms). Trace:
W20260807 11:09:10.437084 23054 rpcz_store.cc:269] 0807 11:09:04.236831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:04.237082 (+ 251us) service_pool.cc:227] Handling call
0807 11:09:10.436573 (+6199491us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:10.438159 23055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
W20260807 11:09:10.440448 23055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51742 (request call id 5) took 6956 ms (client timeout 649 ms). Trace:
W20260807 11:09:10.334662 23060 rpcz_store.cc:269] 0807 11:09:07.282139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:10.334212 (+3052073us) service_pool.cc:214] Skipping call since client already timed out
0807 11:09:10.334306 (+ 94us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 11:09:10.440965 23055 rpcz_store.cc:269] 0807 11:09:03.484209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:03.484476 (+ 267us) service_pool.cc:227] Handling call
0807 11:09:10.440379 (+6955903us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:10.445144 25574 raft_consensus.cc:504] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.449470 24037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:10.451148 23510 leader_election.cc:341] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:10.422731 23059 rpcz_store.cc:269] 0807 11:09:06.361130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:10.330502 (+3969372us) service_pool.cc:214] Skipping call since client already timed out
0807 11:09:10.330599 (+ 97us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260807 11:09:10.452584 23050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40212 (request call id 23) took 5226 ms (client timeout 740 ms). Trace:
W20260807 11:09:10.453061 23050 rpcz_store.cc:269] 0807 11:09:05.226497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:05.226733 (+ 236us) service_pool.cc:227] Handling call
0807 11:09:10.452502 (+5225769us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:10.467835 24266 raft_consensus.cc:348] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.468987 24266 raft_consensus.cc:374] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:10.470723 24266 raft_consensus.cc:729] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:10.478628 25574 leader_election.cc:288] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:10.486239 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:10.486781 23846 raft_consensus.cc:3037] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.492659 23846 raft_consensus.cc:2454] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:10.509338 23507 leader_election.cc:302] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:10.510186 25339 raft_consensus.cc:2781] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:10.510682 25339 raft_consensus.cc:686] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:10.511976 25339 consensus_queue.cc:237] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.471876 24266 consensus_queue.cc:260] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.520925 24261 tablet_bootstrap.cc:492] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:10.526381 24261 tablet_bootstrap.cc:654] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.562012 24261 tablet_bootstrap.cc:492] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:10.562608 24261 ts_tablet_manager.cc:1397] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.011s
I20260807 11:09:10.565861 24261 raft_consensus.cc:348] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.566690 24261 raft_consensus.cc:374] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:10.567019 24261 raft_consensus.cc:729] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:10.568104 24261 consensus_queue.cc:260] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.569679 24261 ts_tablet_manager.cc:1428] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 11:09:10.570766 24261 tablet_bootstrap.cc:492] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:10.591941 25652 consensus_queue.cc:1035] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:10.595005 24261 tablet_bootstrap.cc:654] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.617125 25683 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:10.617596 25683 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:10.620299 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:09:10.620893 25683 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:09:10.627662 24681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:09:10.629271 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:10.631685 25683 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:10.632351 24965 catalog_manager.cc:1259] Loaded cluster ID: 1fc1be4dcf034633aaea4c03e0988a11
I20260807 11:09:10.632658 24965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 11:09:10.639065 24261 tablet_bootstrap.cc:492] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:10.639434 24261 ts_tablet_manager.cc:1397] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.002s
I20260807 11:09:10.641441 24261 raft_consensus.cc:348] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.642052 24261 raft_consensus.cc:374] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:10.642287 24261 raft_consensus.cc:729] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:10.643658 25597 raft_consensus.cc:482] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.644094 25597 raft_consensus.cc:504] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.645977 25597 leader_election.cc:288] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:10.647626 23607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:10.648923 23745 leader_election.cc:341] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.667971 24261 consensus_queue.cc:260] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.688249 24261 ts_tablet_manager.cc:1428] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.049s user 0.004s sys 0.001s
I20260807 11:09:10.706529 25574 consensus_queue.cc:1035] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:10.719753 24261 tablet_bootstrap.cc:492] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
W20260807 11:09:10.721386 23745 consensus_peers.cc:487] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:10.723784 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:10.728961 23510 consensus_peers.cc:487] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:10.729537 23510 consensus_peers.cc:487] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:10.731668 23745 leader_election.cc:341] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.732055 23745 leader_election.cc:302] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
I20260807 11:09:10.733039 24051 raft_consensus.cc:3037] T 907f602c4dce41389e06307270c16f71 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.734313 25597 raft_consensus.cc:2726] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:10.769152 25421 raft_consensus.cc:482] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.769610 25421 raft_consensus.cc:504] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.771552 25421 leader_election.cc:288] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:10.774968 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:10.776249 23510 leader_election.cc:341] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.780995 24266 ts_tablet_manager.cc:1428] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.413s user 0.006s sys 0.000s
I20260807 11:09:10.783583 24266 tablet_bootstrap.cc:492] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:10.785979 25230 raft_consensus.cc:482] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.787724 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:10.788020 25597 raft_consensus.cc:482] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.791589 23846 raft_consensus.cc:2454] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:10.791504 25597 raft_consensus.cc:504] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.796459 25597 leader_election.cc:288] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
I20260807 11:09:10.797766 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:10.798388 23610 raft_consensus.cc:2454] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 0.
I20260807 11:09:10.799304 23745 leader_election.cc:302] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:10.799503 23507 leader_election.cc:302] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:10.800282 25597 raft_consensus.cc:2781] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:10.800442 25421 raft_consensus.cc:2781] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:10.800598 25597 raft_consensus.cc:482] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:10.800729 25421 raft_consensus.cc:482] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:10.800881 25597 raft_consensus.cc:3037] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.801038 25421 raft_consensus.cc:3037] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.786767 25230 raft_consensus.cc:504] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.809710 25230 leader_election.cc:288] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:10.816807 25597 raft_consensus.cc:504] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.807479 25421 raft_consensus.cc:504] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.836445 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:10.837756 23510 leader_election.cc:341] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.834738 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:10.841336 23840 raft_consensus.cc:3037] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.843591 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93"
I20260807 11:09:10.844141 23610 raft_consensus.cc:3037] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:10.850471 23610 raft_consensus.cc:2454] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99a8d4e2c1b14150b03ad0f28e74a011 in term 1.
I20260807 11:09:10.851709 23745 leader_election.cc:302] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:10.852416 25678 raft_consensus.cc:2781] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:10.852867 25678 raft_consensus.cc:686] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Becoming Leader. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Running, Role: LEADER
I20260807 11:09:10.853645 25678 consensus_queue.cc:237] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.813939 24266 tablet_bootstrap.cc:654] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.867340 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:10.871140 24261 tablet_bootstrap.cc:654] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:10.875046 25597 leader_election.cc:288] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Requested vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), c281254655c84a0496c50045c37b22df (127.22.115.195:36683)
W20260807 11:09:10.881928 23951 consensus_peers.cc:487] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84c78502f0a5485c9ffe4434c14567e0. This is attempt 6: this message will repeat every 5th retry.
I20260807 11:09:10.894767 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:10.897579 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a7cbb316e24dd68127b7e13ad6ae68" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:10.898520 23610 raft_consensus.cc:2396] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 11:09:10.900542 25664 consensus_queue.cc:1035] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:10.907218 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:10.908289 23745 leader_election.cc:341] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:10.909129 23745 leader_election.cc:341] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.910167 25421 leader_election.cc:288] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:10.911055 23954 leader_election.cc:302] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:10.921415 25700 raft_consensus.cc:2726] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 11:09:10.927232 24266 tablet_bootstrap.cc:492] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:10.930032 24266 ts_tablet_manager.cc:1397] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.147s user 0.011s sys 0.002s
I20260807 11:09:10.941041 24261 tablet_bootstrap.cc:492] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:10.949206 24261 ts_tablet_manager.cc:1397] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.230s user 0.009s sys 0.001s
I20260807 11:09:10.951117 23840 raft_consensus.cc:2454] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:10.952003 25678 raft_consensus.cc:482] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:10.952417 25678 raft_consensus.cc:504] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.954591 25678 leader_election.cc:288] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:10.955575 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
W20260807 11:09:10.956826 23745 leader_election.cc:341] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:10.958212 24266 raft_consensus.cc:348] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:10.997427 23507 leader_election.cc:302] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
W20260807 11:09:10.998680 23507 consensus_peers.cc:487] T 10f6d2989e09466aaa374575a11f40e3 P 8a668588fabb4a9eba107cd6020f1e93 -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10f6d2989e09466aaa374575a11f40e3. This is attempt 6: this message will repeat every 5th retry.
I20260807 11:09:10.958746 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
W20260807 11:09:11.011673 23745 leader_election.cc:341] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:11.012065 23745 leader_election.cc:302] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99a8d4e2c1b14150b03ad0f28e74a011; no voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df
W20260807 11:09:10.970625 23954 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 59791.4us
I20260807 11:09:11.016235 25678 raft_consensus.cc:2726] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:11.017063 25514 raft_consensus.cc:2781] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:11.017484 25514 raft_consensus.cc:686] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:11.018198 25514 consensus_queue.cc:237] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:11.026537 23951 consensus_peers.cc:487] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64cb221021564d66bfecf5cd91bcec5c. This is attempt 6: this message will repeat every 5th retry.
I20260807 11:09:11.030956 24266 raft_consensus.cc:374] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.031338 24266 raft_consensus.cc:729] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.032011 24266 consensus_queue.cc:260] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.034459 24266 ts_tablet_manager.cc:1428] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.100s user 0.004s sys 0.001s
I20260807 11:09:11.062937 24261 raft_consensus.cc:348] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.063750 24261 raft_consensus.cc:374] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.064047 24261 raft_consensus.cc:729] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.064687 24261 consensus_queue.cc:260] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.066761 24261 ts_tablet_manager.cc:1428] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.114s user 0.004s sys 0.000s
I20260807 11:09:11.087972 24965 catalog_manager.cc:1504] Loading token signing keys...
I20260807 11:09:11.122522 24266 tablet_bootstrap.cc:492] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.082079 25514 consensus_queue.cc:1035] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:11.127863 23610 raft_consensus.cc:1261] T 88a7cbb316e24dd68127b7e13ad6ae68 P 8a668588fabb4a9eba107cd6020f1e93 [term 2 FOLLOWER]: Refusing update from remote peer 99a8d4e2c1b14150b03ad0f28e74a011: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 11:09:11.130187 25678 consensus_queue.cc:1035] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 11:09:11.177286 24261 tablet_bootstrap.cc:492] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:11.191551 24058 raft_consensus.cc:1261] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df [term 2 FOLLOWER]: Refusing update from remote peer 99a8d4e2c1b14150b03ad0f28e74a011: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 11:09:11.192873 25691 consensus_queue.cc:1035] T 88a7cbb316e24dd68127b7e13ad6ae68 P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 11:09:11.178301 23510 consensus_peers.cc:487] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:11.243618 25718 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:11.243968 24266 tablet_bootstrap.cc:654] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.248101 25718 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:11.250793 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:09:11.254005 23187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b43b3e5203ee4ac3a23fa1902356994b" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "18231bef3b524f8ea78d141ae82df928" is_pre_election: true
I20260807 11:09:11.255856 24575 leader_election.cc:302] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b43b3e5203ee4ac3a23fa1902356994b; no voters: 18231bef3b524f8ea78d141ae82df928, 7e598bda106e4ec181b53fc7f305c822
I20260807 11:09:11.261526 25718 leader_election.cc:288] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), 18231bef3b524f8ea78d141ae82df928 (127.22.115.253:40309)
I20260807 11:09:11.262495 25718 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b43b3e5203ee4ac3a23fa1902356994b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:11.286389 24261 tablet_bootstrap.cc:654] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.295034 25230 raft_consensus.cc:482] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:11.295535 25230 raft_consensus.cc:504] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.297434 25230 leader_election.cc:288] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.299090 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:11.299865 23837 raft_consensus.cc:2379] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:11.300709 23607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f87bb654c84064b7bc26864ceb9755" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:11.310699 23954 leader_election.cc:302] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:11.311733 25230 raft_consensus.cc:3037] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.318519 25230 raft_consensus.cc:2726] T 24f87bb654c84064b7bc26864ceb9755 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:11.362239 24266 tablet_bootstrap.cc:492] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.362661 24266 ts_tablet_manager.cc:1397] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.240s user 0.008s sys 0.000s
I20260807 11:09:11.364786 24266 raft_consensus.cc:348] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.379281 24266 raft_consensus.cc:374] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.379565 24266 raft_consensus.cc:729] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.380193 24266 consensus_queue.cc:260] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.382210 24266 ts_tablet_manager.cc:1428] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.019s user 0.004s sys 0.001s
I20260807 11:09:11.391361 24266 tablet_bootstrap.cc:492] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.396359 24266 tablet_bootstrap.cc:654] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.397953 24261 tablet_bootstrap.cc:492] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:11.398341 24261 ts_tablet_manager.cc:1397] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.223s user 0.007s sys 0.002s
I20260807 11:09:11.402891 24261 raft_consensus.cc:348] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.403559 24261 raft_consensus.cc:374] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.403798 24261 raft_consensus.cc:729] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.404349 24261 consensus_queue.cc:260] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.406338 24261 ts_tablet_manager.cc:1428] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260807 11:09:11.425746 24266 tablet_bootstrap.cc:492] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.426142 24266 ts_tablet_manager.cc:1397] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.005s
I20260807 11:09:11.429714 24266 raft_consensus.cc:348] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.430406 24266 raft_consensus.cc:374] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.430639 24266 raft_consensus.cc:729] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.436856 24266 consensus_queue.cc:260] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.438777 24266 ts_tablet_manager.cc:1428] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260807 11:09:11.449047 24266 tablet_bootstrap.cc:492] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.450798 24965 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Loaded TSK: 0
I20260807 11:09:11.457206 24266 tablet_bootstrap.cc:654] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.466820 25563 raft_consensus.cc:482] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:11.467442 25563 raft_consensus.cc:504] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.470136 25563 leader_election.cc:288] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.472458 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:11.473181 23837 raft_consensus.cc:2454] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:11.475817 23507 leader_election.cc:302] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:11.477545 25563 raft_consensus.cc:2781] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:11.477888 25563 raft_consensus.cc:482] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:11.478209 25563 raft_consensus.cc:3037] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.479663 24051 raft_consensus.cc:3037] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.481544 24266 tablet_bootstrap.cc:492] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.481981 24266 ts_tablet_manager.cc:1397] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.000s
I20260807 11:09:11.485842 24266 raft_consensus.cc:348] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.486518 24266 raft_consensus.cc:374] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.486756 24266 raft_consensus.cc:729] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.491147 24266 consensus_queue.cc:260] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.499145 25700 raft_consensus.cc:482] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:11.499632 25700 raft_consensus.cc:504] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.503482 24266 ts_tablet_manager.cc:1428] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.021s user 0.008s sys 0.002s
I20260807 11:09:11.505627 24266 tablet_bootstrap.cc:492] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.505904 25700 leader_election.cc:288] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.508690 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:11.508792 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
W20260807 11:09:11.513437 23510 leader_election.cc:341] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:11.519938 24261 tablet_bootstrap.cc:492] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:11.523687 24266 tablet_bootstrap.cc:654] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.528355 24261 tablet_bootstrap.cc:654] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.537703 24261 tablet_bootstrap.cc:492] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
I20260807 11:09:11.538087 24261 ts_tablet_manager.cc:1397] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.009s
I20260807 11:09:11.544795 24266 tablet_bootstrap.cc:492] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.545220 24266 ts_tablet_manager.cc:1397] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.005s
I20260807 11:09:11.546075 24965 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 11:09:11.547995 24266 raft_consensus.cc:348] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.548681 24266 raft_consensus.cc:374] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.548918 24266 raft_consensus.cc:729] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.549523 24266 consensus_queue.cc:260] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.551388 24261 raft_consensus.cc:348] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.552018 24261 raft_consensus.cc:374] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.552263 24261 raft_consensus.cc:729] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.552769 24261 consensus_queue.cc:260] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.554874 24261 ts_tablet_manager.cc:1428] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.017s user 0.002s sys 0.002s
I20260807 11:09:11.555706 24261 tablet_bootstrap.cc:492] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93: Bootstrap starting.
I20260807 11:09:11.560672 24266 ts_tablet_manager.cc:1428] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260807 11:09:11.561625 24266 tablet_bootstrap.cc:492] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.567287 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ebf05f3933a433cb7201f6c1f9e11c9" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:11.570578 23954 leader_election.cc:302] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:11.570911 24266 tablet_bootstrap.cc:654] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.571671 25230 raft_consensus.cc:2726] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:11.577068 24261 tablet_bootstrap.cc:654] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.578382 25728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:11.497031 25563 raft_consensus.cc:504] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.578979 25728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:11.581943 25563 leader_election.cc:288] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.582813 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:09:11.583575 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:11.584353 24681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 259 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:09:11.585940 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:11.590088 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:11.590657 23837 raft_consensus.cc:3037] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.592226 25728 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:09:11.595520 25728 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:11.597139 24266 tablet_bootstrap.cc:492] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.597599 24266 ts_tablet_manager.cc:1397] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.036s user 0.015s sys 0.001s
I20260807 11:09:11.602414 24266 raft_consensus.cc:348] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.603087 24266 raft_consensus.cc:374] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.606760 24266 raft_consensus.cc:729] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.607434 24266 consensus_queue.cc:260] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.633925 24266 ts_tablet_manager.cc:1428] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.036s user 0.010s sys 0.000s
I20260807 11:09:11.634979 24261 tablet_bootstrap.cc:492] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93: No bootstrap required, opened a new log
W20260807 11:09:11.635051 23510 leader_election.cc:341] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:11.636343 24266 tablet_bootstrap.cc:492] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.636053 24261 ts_tablet_manager.cc:1397] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93: Time spent bootstrapping tablet: real 0.081s user 0.014s sys 0.007s
I20260807 11:09:11.637048 25678 consensus_queue.cc:1035] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:11.642011 24057 raft_consensus.cc:3037] T d3011806841f46f898920b1a11404f85 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.639395 24261 raft_consensus.cc:348] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.649434 24261 raft_consensus.cc:374] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.649703 24261 raft_consensus.cc:729] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.650259 24261 consensus_queue.cc:260] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.655426 24266 tablet_bootstrap.cc:654] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:11.680812 23141 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.252:40555, user_credentials={real_user=slave}} blocked reactor thread for 94993.6us
I20260807 11:09:11.689872 24261 ts_tablet_manager.cc:1428] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93: Time spent starting tablet: real 0.053s user 0.002s sys 0.003s
I20260807 11:09:11.690968 25339 raft_consensus.cc:482] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:11.691388 25339 raft_consensus.cc:504] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.693190 25339 leader_election.cc:288] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.697258 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:11.695551 25721 consensus_queue.cc:1035] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:11.697818 23840 raft_consensus.cc:2454] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:11.711679 23507 leader_election.cc:302] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:11.712785 25664 raft_consensus.cc:2781] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:11.713109 25664 raft_consensus.cc:482] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:11.713578 25664 raft_consensus.cc:3037] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.715513 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:11.731989 23837 raft_consensus.cc:2454] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:11.742794 24054 raft_consensus.cc:3037] T da4a85755e5a4f53ba2d785020b0a8e2 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.743278 25339 consensus_queue.cc:1035] T 24f87bb654c84064b7bc26864ceb9755 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:11.756621 23507 leader_election.cc:302] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:11.757375 25339 raft_consensus.cc:2781] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:11.758108 25339 raft_consensus.cc:686] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:11.758639 24266 tablet_bootstrap.cc:492] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.759145 24266 ts_tablet_manager.cc:1397] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.124s user 0.024s sys 0.004s
I20260807 11:09:11.758801 25339 consensus_queue.cc:237] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.762419 25700 raft_consensus.cc:482] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8a668588fabb4a9eba107cd6020f1e93)
I20260807 11:09:11.763034 25700 raft_consensus.cc:504] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.764897 25664 raft_consensus.cc:504] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.765625 25700 leader_election.cc:288] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.766525 24266 raft_consensus.cc:348] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.771456 24266 raft_consensus.cc:374] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.771575 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:11.771745 24266 raft_consensus.cc:729] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.772469 24266 consensus_queue.cc:260] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.775111 24266 ts_tablet_manager.cc:1428] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260807 11:09:11.776134 24266 tablet_bootstrap.cc:492] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.791800 25664 leader_election.cc:288] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.794206 24266 tablet_bootstrap.cc:654] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:11.792384 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 49998us
W20260807 11:09:11.797125 23510 leader_election.cc:341] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
W20260807 11:09:11.803929 25745 log.cc:924] Time spent T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011: Append to log took a long time: real 0.053s user 0.000s sys 0.001s
I20260807 11:09:11.825050 24266 tablet_bootstrap.cc:492] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.825544 24266 ts_tablet_manager.cc:1397] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.005s
I20260807 11:09:11.827868 24266 raft_consensus.cc:348] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.828542 24266 raft_consensus.cc:374] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.828802 24266 raft_consensus.cc:729] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.839160 24266 consensus_queue.cc:260] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.841310 24266 ts_tablet_manager.cc:1428] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260807 11:09:11.842322 24266 tablet_bootstrap.cc:492] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:09:11.843406 23507 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.194:39497, user_credentials={real_user=slave}} blocked reactor thread for 86867.9us
I20260807 11:09:11.859813 24266 tablet_bootstrap.cc:654] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.863775 24051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
W20260807 11:09:11.866922 23745 consensus_peers.cc:487] T 39efd13118454aa983918238928ef2bc P 99a8d4e2c1b14150b03ad0f28e74a011 -> Peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Couldn't send request to peer c281254655c84a0496c50045c37b22df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:11.872926 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd1a829d01c41f28a54cf4e3d9c3099" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:11.877853 24266 tablet_bootstrap.cc:492] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.878299 24266 ts_tablet_manager.cc:1397] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.000s
I20260807 11:09:11.891783 24266 raft_consensus.cc:348] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.898797 24266 raft_consensus.cc:374] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.899204 24266 raft_consensus.cc:729] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.900049 24266 consensus_queue.cc:260] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.902262 24266 ts_tablet_manager.cc:1428] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20260807 11:09:11.903143 24266 tablet_bootstrap.cc:492] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.911916 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:11.912459 23840 raft_consensus.cc:3037] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:11.915711 24266 tablet_bootstrap.cc:654] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.918933 23840 raft_consensus.cc:2454] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:11.922734 25574 raft_consensus.cc:482] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:11.923190 25574 raft_consensus.cc:504] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.925005 25574 leader_election.cc:288] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:11.927987 24266 tablet_bootstrap.cc:492] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.928429 24266 ts_tablet_manager.cc:1397] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.004s
I20260807 11:09:11.932046 24266 raft_consensus.cc:348] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.938951 24266 raft_consensus.cc:374] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.939257 24266 raft_consensus.cc:729] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.939893 24266 consensus_queue.cc:260] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.942226 24266 ts_tablet_manager.cc:1428] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260807 11:09:11.943303 23954 leader_election.cc:302] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:11.944042 25700 raft_consensus.cc:2726] T cdd1a829d01c41f28a54cf4e3d9c3099 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:11.945755 24266 tablet_bootstrap.cc:492] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:11.951951 24266 tablet_bootstrap.cc:654] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:11.959300 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:11.959933 23840 raft_consensus.cc:2454] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:11.963254 23507 leader_election.cc:302] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:11.964591 25339 raft_consensus.cc:2781] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:11.965044 25339 raft_consensus.cc:686] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
W20260807 11:09:11.965065 23510 leader_election.cc:341] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:11.966092 25339 consensus_queue.cc:237] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.974740 24266 tablet_bootstrap.cc:492] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:11.975234 24266 ts_tablet_manager.cc:1397] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.000s
I20260807 11:09:11.978551 24266 raft_consensus.cc:348] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:11.981341 24266 raft_consensus.cc:374] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:11.981652 24266 raft_consensus.cc:729] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:11.982295 24266 consensus_queue.cc:260] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.005754 23507 leader_election.cc:302] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:12.007340 25574 raft_consensus.cc:2781] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:12.007833 25574 raft_consensus.cc:482] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:12.008201 25574 raft_consensus.cc:3037] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.019140 24266 ts_tablet_manager.cc:1428] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260807 11:09:12.020092 24266 tablet_bootstrap.cc:492] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:12.021283 25700 raft_consensus.cc:482] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.021714 25700 raft_consensus.cc:504] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.022136 24054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:12.028244 25700 leader_election.cc:288] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.028445 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.062891 23041 catalog_manager.cc:5495] T 24f87bb654c84064b7bc26864ceb9755 P 99a8d4e2c1b14150b03ad0f28e74a011 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:12.080183 24266 tablet_bootstrap.cc:654] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:12.081642 23043 master_service.cc:946] ReplaceTablet: received request to replace tablet 64cb221021564d66bfecf5cd91bcec5c from {username='slave'} at 127.0.0.1:53338
I20260807 11:09:12.082840 23036 master_service.cc:946] ReplaceTablet: received request to replace tablet b62eea967fed4adc84252b8366609878 from {username='slave'} at 127.0.0.1:53338
I20260807 11:09:12.084025 23046 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_737942ecd7474568a87760d0e62550d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:09:12.086659 23046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_737942ecd7474568a87760d0e62550d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:09:12.096393 23043 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_68575b95a3f045c989a91bff8785baed" } new_table_name: "default.Table_9c4a12ea275143bc997a974a47ac3352" modify_external_catalogs: true
I20260807 11:09:12.097702 23040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6142de128f694ccfb31fcbde5ffd7d94" } modify_external_catalogs: true
I20260807 11:09:12.098253 23040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_6142de128f694ccfb31fcbde5ffd7d94" } modify_external_catalogs: true
I20260807 11:09:12.100526 23037 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_d894912784884ed891b1dc392d32d96d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:09:12.102202 23037 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d894912784884ed891b1dc392d32d96d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:09:12.112856 23042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_b226b03cf22c4dbf9a1be5ec1499a367" } modify_external_catalogs: true
I20260807 11:09:12.113370 23042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_b226b03cf22c4dbf9a1be5ec1499a367" } modify_external_catalogs: true
I20260807 11:09:12.115533 23607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7d0cab3da641f4abca60a8beff381e" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:12.118693 23045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_c966fe949c594615984beb609b2293d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:09:12.120205 23045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c966fe949c594615984beb609b2293d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:09:12.125563 23035 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53338:
table { table_name: "default.Table_776b2db76b154e8b8bc73b21a93265eb" } new_table_name: "default.Table_03c24b5b89614362901773b741bd8b4e" modify_external_catalogs: true
I20260807 11:09:12.140702 24057 raft_consensus.cc:3037] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.146695 25230 raft_consensus.cc:482] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.147171 25230 raft_consensus.cc:504] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } }
I20260807 11:09:12.147972 25740 raft_consensus.cc:482] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.148525 25740 raft_consensus.cc:504] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.155678 23954 leader_election.cc:302] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:12.156126 25740 leader_election.cc:288] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.015519 25574 raft_consensus.cc:504] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.165599 24055 raft_consensus.cc:3037] T 2ebf05f3933a433cb7201f6c1f9e11c9 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.166977 25230 leader_election.cc:288] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
I20260807 11:09:12.183313 23834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.185557 25574 leader_election.cc:288] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.195858 25230 raft_consensus.cc:482] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.196382 25230 raft_consensus.cc:504] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.203217 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.204023 23837 raft_consensus.cc:2379] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:12.198629 25230 leader_election.cc:288] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:12.205821 23951 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
I20260807 11:09:12.210870 25740 raft_consensus.cc:2726] T 4c7d0cab3da641f4abca60a8beff381e P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:12.215701 24266 tablet_bootstrap.cc:492] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:12.216110 24266 ts_tablet_manager.cc:1397] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.196s user 0.012s sys 0.008s
I20260807 11:09:12.218883 24266 raft_consensus.cc:348] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.219547 24266 raft_consensus.cc:374] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:12.219779 24266 raft_consensus.cc:729] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:12.220335 24266 consensus_queue.cc:260] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.226102 25664 raft_consensus.cc:482] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.226573 25664 raft_consensus.cc:504] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.228799 25664 leader_election.cc:288] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:12.231786 23510 leader_election.cc:341] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:12.244359 23048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "default.Table_125f24489a504d04a6747e824b56c884"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:12.245308 24127 heartbeater.cc:503] Master 127.22.115.254:40237 was elected leader, sending a full tablet report...
W20260807 11:09:12.245839 23048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_125f24489a504d04a6747e824b56c884 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:09:12.266228 25230 raft_consensus.cc:482] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.266767 25230 raft_consensus.cc:504] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.273010 25230 leader_election.cc:288] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.276584 24266 ts_tablet_manager.cc:1428] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.060s user 0.006s sys 0.000s
I20260807 11:09:12.280980 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.281955 23840 raft_consensus.cc:2379] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:12.299510 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:12.300191 23840 raft_consensus.cc:3037] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.300524 25230 raft_consensus.cc:482] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.300966 25230 raft_consensus.cc:504] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.302619 25230 leader_election.cc:288] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.304952 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.314427 24266 tablet_bootstrap.cc:492] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:12.333801 25230 raft_consensus.cc:482] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.334297 25230 raft_consensus.cc:504] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.336032 25230 leader_election.cc:288] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.338151 23836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.344607 24266 tablet_bootstrap.cc:654] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:12.369727 23837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.370375 23837 raft_consensus.cc:2454] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:12.374711 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e965a1dc66c414285df6727d2982e12" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:12.375332 24055 raft_consensus.cc:3037] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.381713 24055 raft_consensus.cc:2454] T 4e965a1dc66c414285df6727d2982e12 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:12.395289 25574 raft_consensus.cc:482] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.395732 25574 raft_consensus.cc:504] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.396072 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:12.396463 24266 tablet_bootstrap.cc:492] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:12.396853 24266 ts_tablet_manager.cc:1397] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.083s user 0.013s sys 0.000s
I20260807 11:09:12.397435 25574 leader_election.cc:288] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.400522 23610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5dfdf237bab4aefbd1a45325d741cf5" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:12.402132 23608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6ec7dbecd7a4fb0a0da16e00df84d22" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:12.409859 24266 raft_consensus.cc:348] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.410548 24266 raft_consensus.cc:374] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:12.410802 24266 raft_consensus.cc:729] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:12.415354 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7c92ce240b4bbf8aa2457e5ec0ccb0" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:12.416854 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39efd13118454aa983918238928ef2bc" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:12.417951 23840 raft_consensus.cc:2454] T 4e965a1dc66c414285df6727d2982e12 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:12.419016 23616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af30e8f4acfb48db875017c1db21f433" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:12.421947 24266 consensus_queue.cc:260] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.425550 24266 ts_tablet_manager.cc:1428] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260807 11:09:12.427001 24055 raft_consensus.cc:3037] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.432041 25664 consensus_queue.cc:1035] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:12.432055 23507 leader_election.cc:302] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:12.434065 25721 raft_consensus.cc:2781] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:12.433916 24057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df" is_pre_election: true
I20260807 11:09:12.434367 25721 raft_consensus.cc:482] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:12.434672 25721 raft_consensus.cc:3037] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.435390 23954 leader_election.cc:302] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:12.436317 25230 raft_consensus.cc:2726] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:12.437378 23954 leader_election.cc:341] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Not found: Tablet not found: 655d379cab56486d872738de6acdffef
I20260807 11:09:12.437711 23954 leader_election.cc:302] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:12.438642 25230 raft_consensus.cc:2726] T 655d379cab56486d872738de6acdffef P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:12.440021 23954 leader_election.cc:302] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:12.440948 25230 raft_consensus.cc:3037] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.447683 24266 tablet_bootstrap.cc:492] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:12.448750 25230 raft_consensus.cc:2726] T d6ec7dbecd7a4fb0a0da16e00df84d22 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:12.450099 25721 raft_consensus.cc:504] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.452129 25721 leader_election.cc:288] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.465626 23507 leader_election.cc:302] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:12.466979 25785 raft_consensus.cc:2781] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:12.467486 25785 raft_consensus.cc:686] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:12.468425 25785 consensus_queue.cc:237] T 4e965a1dc66c414285df6727d2982e12 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.478655 23954 leader_election.cc:302] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:12.479802 23954 leader_election.cc:302] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:12.480742 23954 leader_election.cc:302] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:12.481691 25740 raft_consensus.cc:2726] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:12.482342 25740 raft_consensus.cc:2726] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:12.486413 23835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.487185 23835 raft_consensus.cc:2454] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 0.
I20260807 11:09:12.487344 25739 raft_consensus.cc:2726] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:12.492672 23846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:12.493206 23846 raft_consensus.cc:3037] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:12.494434 23510 leader_election.cc:341] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:12.499866 23507 leader_election.cc:302] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters:
I20260807 11:09:12.468262 24266 tablet_bootstrap.cc:654] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:12.500676 25574 raft_consensus.cc:2781] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:12.501016 25574 raft_consensus.cc:482] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:12.501339 25574 raft_consensus.cc:3037] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 0 FOLLOWER]: Advancing to term 1
W20260807 11:09:12.505450 23510 leader_election.cc:341] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:12.508419 25574 raft_consensus.cc:504] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.510262 25574 leader_election.cc:288] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Requested vote from peers c281254655c84a0496c50045c37b22df (127.22.115.195:36683), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.512341 23846 raft_consensus.cc:2454] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:12.514634 25722 consensus_queue.cc:1035] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:12.515054 24055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6ebc139f3744d6c9682e3c3ab1ae8dd" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:12.515643 24055 raft_consensus.cc:3037] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.518329 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011"
I20260807 11:09:12.519027 23840 raft_consensus.cc:3037] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.522716 24057 raft_consensus.cc:3037] T af30e8f4acfb48db875017c1db21f433 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.532419 24058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "8a668588fabb4a9eba107cd6020f1e93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c281254655c84a0496c50045c37b22df"
I20260807 11:09:12.541878 23840 raft_consensus.cc:2454] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
I20260807 11:09:12.542797 24055 raft_consensus.cc:2454] T a6ebc139f3744d6c9682e3c3ab1ae8dd P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a668588fabb4a9eba107cd6020f1e93 in term 1.
W20260807 11:09:12.560904 23510 leader_election.cc:341] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c281254655c84a0496c50045c37b22df (127.22.115.195:36683): Illegal state: must be running to vote when last-logged opid is not known
I20260807 11:09:12.561530 23510 leader_election.cc:302] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, c281254655c84a0496c50045c37b22df; no voters:
I20260807 11:09:12.565353 23036 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet b62eea967fed4adc84252b8366609878
I20260807 11:09:12.566716 23036 catalog_manager.cc:6565] ReplaceTablet: tablet b62eea967fed4adc84252b8366609878 deleted and replaced by tablet 248032b6e6fd480d82cfe8603d6d0513
I20260807 11:09:12.570744 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet b62eea967fed4adc84252b8366609878 with delete_type TABLET_DATA_DELETED (replaced by tablet 248032b6e6fd480d82cfe8603d6d0513) from {username='slave'} at 127.0.0.1:56920
I20260807 11:09:12.570883 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet b62eea967fed4adc84252b8366609878 with delete_type TABLET_DATA_DELETED (replaced by tablet 248032b6e6fd480d82cfe8603d6d0513) from {username='slave'} at 127.0.0.1:40310
I20260807 11:09:12.576501 23580 tablet_service.cc:1514] Processing DeleteTablet for tablet b62eea967fed4adc84252b8366609878 with delete_type TABLET_DATA_DELETED (replaced by tablet 248032b6e6fd480d82cfe8603d6d0513) from {username='slave'} at 127.0.0.1:52302
I20260807 11:09:12.588181 25799 tablet_replica.cc:330] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:09:12.589349 25799 raft_consensus.cc:2229] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:12.589973 25799 raft_consensus.cc:2258] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:12.595628 25798 tablet_replica.cc:330] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:09:12.603813 23507 leader_election.cc:302] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011; no voters: c281254655c84a0496c50045c37b22df
I20260807 11:09:12.606612 25800 tablet_replica.cc:330] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: stopping tablet replica
I20260807 11:09:12.607654 25800 raft_consensus.cc:2229] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:12.613230 25799 ts_tablet_manager.cc:1905] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:12.631634 25339 raft_consensus.cc:2781] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:12.632097 25339 raft_consensus.cc:686] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:12.632751 25339 consensus_queue.cc:237] T 81f0b6867c524174a48a92758e566a95 P 8a668588fabb4a9eba107cd6020f1e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
W20260807 11:09:12.640421 23510 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.115.195:36683, user_credentials={real_user=slave}} blocked reactor thread for 78940.5us
I20260807 11:09:12.641494 25574 raft_consensus.cc:2781] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:12.645339 25574 raft_consensus.cc:686] T a6ebc139f3744d6c9682e3c3ab1ae8dd P 8a668588fabb4a9eba107cd6020f1e93 [term 1 LEADER]: Becoming Leader. State: Replica: 8a668588fabb4a9eba107cd6020f1e93, State: Running, Role: LEADER
I20260807 11:09:12.649948 25799 ts_tablet_manager.cc:1918] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260807 11:09:12.650537 25799 log.cc:1196] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/b62eea967fed4adc84252b8366609878
I20260807 11:09:12.651551 24055 raft_consensus.cc:3037] T c5dfdf237bab4aefbd1a45325d741cf5 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.651677 25799 ts_tablet_manager.cc:1939] T b62eea967fed4adc84252b8366609878 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:09:12.652976 24266 tablet_bootstrap.cc:492] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:12.653386 24266 ts_tablet_manager.cc:1397] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.206s user 0.020s sys 0.003s
I20260807 11:09:12.654865 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet b62eea967fed4adc84252b8366609878 (table default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06]) successfully deleted
I20260807 11:09:12.655807 24266 raft_consensus.cc:348] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.656473 24266 raft_consensus.cc:374] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:12.656716 24266 raft_consensus.cc:729] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:12.657356 24266 consensus_queue.cc:260] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.659627 24266 ts_tablet_manager.cc:1428] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 11:09:12.672027 25800 raft_consensus.cc:2258] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:12.674520 25800 ts_tablet_manager.cc:1905] T b62eea967fed4adc84252b8366609878 P 8a668588fabb4a9eba107cd6020f1e93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:12.677996 25230 raft_consensus.cc:482] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:12.678419 25230 raft_consensus.cc:504] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:12.680109 25230 leader_election.cc:288] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:12.682191 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:12.683004 23840 raft_consensus.cc:2379] T 741fdb38a64c4e63a6efc447c6f5ca1f P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
I20260807 11:09:12.705047 23614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741fdb38a64c4e63a6efc447c6f5ca1f" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a668588fabb4a9eba107cd6020f1e93" is_pre_election: true
I20260807 11:09:12.711922 23042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 5f41042d50184ecf9bbd2c225c86aabf
W20260807 11:09:12.712234 23043 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b53e85597f6e44f08e3076d2622d44c3 has no consensus state
I20260807 11:09:12.714772 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f41042d50184ecf9bbd2c225c86aabf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:09:12 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:09:12.716197 25798 raft_consensus.cc:2229] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:09:12.717159 25798 raft_consensus.cc:2258] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 11:09:12.721913 23035 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2108b1d026bb42a88f95fef8badb1d77 consensus state has no leader
I20260807 11:09:12.724056 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f41042d50184ecf9bbd2c225c86aabf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:09:12 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:09:12.726430 22991 master-stress-test.cc:580] Killed test thread 1/10
I20260807 11:09:12.726884 22991 master-stress-test.cc:578] Killing test thread 2/10
I20260807 11:09:12.728711 23040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: Sending DeleteTablet for 3 replicas of tablet 95fc220a912543eb8f43d6379795ca03
I20260807 11:09:12.729456 23917 heartbeater.cc:503] Master 127.22.115.254:40237 was elected leader, sending a full tablet report...
I20260807 11:09:12.731022 23795 tablet_service.cc:1514] Processing DeleteTablet for tablet 95fc220a912543eb8f43d6379795ca03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:09:12 UTC) from {username='slave'} at 127.0.0.1:56920
I20260807 11:09:12.731184 25799 tablet_replica.cc:330] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:09:12.735497 24019 tablet_service.cc:1514] Processing DeleteTablet for tablet 95fc220a912543eb8f43d6379795ca03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 11:09:12 UTC) from {username='slave'} at 127.0.0.1:40310
I20260807 11:09:12.735608 25798 ts_tablet_manager.cc:1905] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 11:09:12.741142 23027 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2108b1d026bb42a88f95fef8badb1d77 (table default.Table_03c24b5b89614362901773b741bd8b4e [id=5c4a7629628b43dd940b6de0264cb7cd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2108b1d026bb42a88f95fef8badb1d77 consensus state has no leader
I20260807 11:09:12.748679 22991 master-stress-test.cc:580] Killed test thread 2/10
I20260807 11:09:12.748941 22991 master-stress-test.cc:578] Killing test thread 3/10
I20260807 11:09:12.749166 22991 master-stress-test.cc:580] Killed test thread 3/10
I20260807 11:09:12.749343 22991 master-stress-test.cc:578] Killing test thread 4/10
I20260807 11:09:12.749560 22991 master-stress-test.cc:580] Killed test thread 4/10
I20260807 11:09:12.749770 22991 master-stress-test.cc:578] Killing test thread 5/10
I20260807 11:09:12.750306 22991 master-stress-test.cc:580] Killed test thread 5/10
I20260807 11:09:12.750507 22991 master-stress-test.cc:578] Killing test thread 6/10
I20260807 11:09:12.755020 22991 master-stress-test.cc:580] Killed test thread 6/10
I20260807 11:09:12.755298 22991 master-stress-test.cc:578] Killing test thread 7/10
I20260807 11:09:12.755843 22991 master-stress-test.cc:580] Killed test thread 7/10
I20260807 11:09:12.757942 25798 ts_tablet_manager.cc:1918] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260807 11:09:12.758421 25798 log.cc:1196] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/b62eea967fed4adc84252b8366609878
I20260807 11:09:12.759562 25798 ts_tablet_manager.cc:1939] T b62eea967fed4adc84252b8366609878 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:09:12.760033 22991 master-stress-test.cc:578] Killing test thread 8/10
I20260807 11:09:12.760648 22991 master-stress-test.cc:580] Killed test thread 8/10
I20260807 11:09:12.761240 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet b62eea967fed4adc84252b8366609878 (table default.Table_4d723c16c0a4467983d16fc085d8a92c [id=16f0e59495a34bddaa4420a6bec3df06]) successfully deleted
I20260807 11:09:12.762076 22991 master-stress-test.cc:578] Killing test thread 9/10
I20260807 11:09:12.762763 25798 tablet_replica.cc:330] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:09:12.763227 22991 master-stress-test.cc:580] Killed test thread 9/10
I20260807 11:09:12.763660 25798 raft_consensus.cc:2229] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:12.764467 22991 master-stress-test.cc:578] Killing test thread 10/10
I20260807 11:09:12.766158 22991 master-stress-test.cc:580] Killed test thread 10/10
I20260807 11:09:12.766510 25798 raft_consensus.cc:2258] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:12.769136 25798 ts_tablet_manager.cc:1905] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:12.769532 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 23466
I20260807 11:09:12.788103 25798 ts_tablet_manager.cc:1918] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:12.788497 25798 log.cc:1196] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/5f41042d50184ecf9bbd2c225c86aabf
I20260807 11:09:12.789232 25798 ts_tablet_manager.cc:1939] T 5f41042d50184ecf9bbd2c225c86aabf P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:09:12.792811 25798 tablet_replica.cc:330] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: stopping tablet replica
I20260807 11:09:12.793141 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 5f41042d50184ecf9bbd2c225c86aabf (table default.Table_b226b03cf22c4dbf9a1be5ec1499a367 [id=00a5f697df75490eaed389c034050304]) successfully deleted
I20260807 11:09:12.793799 25798 raft_consensus.cc:2229] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:12.794308 25798 raft_consensus.cc:2258] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:12.828469 25798 ts_tablet_manager.cc:1905] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:12.838370 25799 raft_consensus.cc:2229] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:12.838975 25799 raft_consensus.cc:2258] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:12.840942 25799 ts_tablet_manager.cc:1905] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:12.847226 24055 raft_consensus.cc:3037] T 39efd13118454aa983918238928ef2bc P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:12.850260 25798 ts_tablet_manager.cc:1918] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:12.850623 25798 log.cc:1196] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/95fc220a912543eb8f43d6379795ca03
I20260807 11:09:12.851351 25798 ts_tablet_manager.cc:1939] T 95fc220a912543eb8f43d6379795ca03 P 99a8d4e2c1b14150b03ad0f28e74a011: Deleting consensus metadata
I20260807 11:09:12.854053 23027 catalog_manager.cc:4841] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): tablet 95fc220a912543eb8f43d6379795ca03 (table default.Table_6142de128f694ccfb31fcbde5ffd7d94 [id=df7d6690afb347e890c89bbb8cbd8875]) successfully deleted
I20260807 11:09:12.871964 25799 ts_tablet_manager.cc:1918] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:12.872399 25799 log.cc:1196] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/5f41042d50184ecf9bbd2c225c86aabf
I20260807 11:09:12.873296 25799 ts_tablet_manager.cc:1939] T 5f41042d50184ecf9bbd2c225c86aabf P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:09:12.891640 25825 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e598bda106e4ec181b53fc7f305c822)
I20260807 11:09:12.892261 25825 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e598bda106e4ec181b53fc7f305c822" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 40237 } } peers { permanent_uuid: "18231bef3b524f8ea78d141ae82df928" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 40309 } } peers { permanent_uuid: "b43b3e5203ee4ac3a23fa1902356994b" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 40555 } }
I20260807 11:09:12.907094 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 5f41042d50184ecf9bbd2c225c86aabf (table default.Table_b226b03cf22c4dbf9a1be5ec1499a367 [id=00a5f697df75490eaed389c034050304]) successfully deleted
I20260807 11:09:12.915062 25799 tablet_replica.cc:330] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: stopping tablet replica
I20260807 11:09:12.916149 23050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 260 } } ignore_live_leader: false dest_uuid: "7e598bda106e4ec181b53fc7f305c822" is_pre_election: true
I20260807 11:09:12.919773 25825 leader_election.cc:288] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e598bda106e4ec181b53fc7f305c822 (127.22.115.254:40237), b43b3e5203ee4ac3a23fa1902356994b (127.22.115.252:40555)
I20260807 11:09:12.920928 24681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18231bef3b524f8ea78d141ae82df928" candidate_term: 5 candidate_status { last_received { term: 4 index: 260 } } ignore_live_leader: false dest_uuid: "b43b3e5203ee4ac3a23fa1902356994b" is_pre_election: true
I20260807 11:09:12.922389 23141 leader_election.cc:302] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18231bef3b524f8ea78d141ae82df928; no voters: 7e598bda106e4ec181b53fc7f305c822, b43b3e5203ee4ac3a23fa1902356994b
I20260807 11:09:12.923396 25799 raft_consensus.cc:2229] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:12.924017 25799 raft_consensus.cc:2258] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:12.932703 25799 ts_tablet_manager.cc:1905] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:12.970754 25799 ts_tablet_manager.cc:1918] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:12.983114 25799 log.cc:1196] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/95fc220a912543eb8f43d6379795ca03
I20260807 11:09:12.988459 25825 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 18231bef3b524f8ea78d141ae82df928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:12.993110 25799 ts_tablet_manager.cc:1939] T 95fc220a912543eb8f43d6379795ca03 P c281254655c84a0496c50045c37b22df: Deleting consensus metadata
I20260807 11:09:13.005288 23030 catalog_manager.cc:4841] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683): tablet 95fc220a912543eb8f43d6379795ca03 (table default.Table_6142de128f694ccfb31fcbde5ffd7d94 [id=df7d6690afb347e890c89bbb8cbd8875]) successfully deleted
W20260807 11:09:13.043641 23951 consensus_peers.cc:487] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d78ed82613064935919934df7124d707. This is attempt 6: this message will repeat every 5th retry.
I20260807 11:09:13.048223 24019 tablet_service.cc:1467] Processing CreateTablet for tablet b53e85597f6e44f08e3076d2622d44c3 (DEFAULT_TABLE table=default.Table_9c4a12ea275143bc997a974a47ac3352 [id=efebaf241d40428db31da62407816203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.049403 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b53e85597f6e44f08e3076d2622d44c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.049192 23796 tablet_service.cc:1467] Processing CreateTablet for tablet acae47d486e645afa2e42323864fa370 (DEFAULT_TABLE table=default.Table_3ad860f1514e47d9951f2ca82b21044f [id=e97c2a634a534b23a3ffd3699c86a28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.050720 23036 catalog_manager.cc:5495] T 6a427e865f1c4d938483a8222a95307e P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.052277 23036 catalog_manager.cc:5495] T 741fdb38a64c4e63a6efc447c6f5ca1f P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: UNKNOWN } } }
I20260807 11:09:13.052824 23795 tablet_service.cc:1467] Processing CreateTablet for tablet b53e85597f6e44f08e3076d2622d44c3 (DEFAULT_TABLE table=default.Table_9c4a12ea275143bc997a974a47ac3352 [id=efebaf241d40428db31da62407816203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.053894 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acae47d486e645afa2e42323864fa370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.053637 23036 catalog_manager.cc:5495] T 6a92aa4664c54114a8816710820e3864 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.056725 23795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b53e85597f6e44f08e3076d2622d44c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.064420 24012 tablet_service.cc:1467] Processing CreateTablet for tablet acae47d486e645afa2e42323864fa370 (DEFAULT_TABLE table=default.Table_3ad860f1514e47d9951f2ca82b21044f [id=e97c2a634a534b23a3ffd3699c86a28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.067905 23803 tablet_service.cc:1467] Processing CreateTablet for tablet 6fde3f237aa54f24b955c4244224a6ea (DEFAULT_TABLE table=default.Table_07911aa3b4c244118be60ebcc25a777a [id=e2e06aca451241a2b4d4c84ccabfc1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.068014 23799 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7574a78a6546b6bf3d51635773b693 (DEFAULT_TABLE table=default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.054742 23036 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 6a92aa4664c54114a8816710820e3864 (table default.Table_1ba07f688e5f42a18c6985eaf65e16e1 [id=282f43d738714393ba1c23189d039355]). Expected version 1 got 0
I20260807 11:09:13.069067 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fde3f237aa54f24b955c4244224a6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.069479 23036 catalog_manager.cc:5495] T d6ec7dbecd7a4fb0a0da16e00df84d22 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: UNKNOWN } } }
I20260807 11:09:13.070941 23036 catalog_manager.cc:5495] T aea90f7a10234f2da4fff089afe87a1e P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.071720 23797 tablet_service.cc:1467] Processing CreateTablet for tablet 25c60c0060b647d498ca71201bb0936b (DEFAULT_TABLE table=default.Table_ea2db3b5e44a42f78e63ba9a33356768 [id=e1fe10ed4bee4ca987b3dc755534d28e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.072000 23036 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet aea90f7a10234f2da4fff089afe87a1e (table default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]). Expected version 1 got 0
I20260807 11:09:13.072602 23036 catalog_manager.cc:5495] T cdd1a829d01c41f28a54cf4e3d9c3099 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.077987 24018 tablet_service.cc:1467] Processing CreateTablet for tablet 6fde3f237aa54f24b955c4244224a6ea (DEFAULT_TABLE table=default.Table_07911aa3b4c244118be60ebcc25a777a [id=e2e06aca451241a2b4d4c84ccabfc1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.079479 24011 tablet_service.cc:1467] Processing CreateTablet for tablet 25c60c0060b647d498ca71201bb0936b (DEFAULT_TABLE table=default.Table_ea2db3b5e44a42f78e63ba9a33356768 [id=e1fe10ed4bee4ca987b3dc755534d28e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.080878 24008 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7574a78a6546b6bf3d51635773b693 (DEFAULT_TABLE table=default.Table_54d50719e43e4c5e80fc27f01fcdb1d0 [id=d13e9b5701684ece9701197bce9e138f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.088521 24012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acae47d486e645afa2e42323864fa370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.074067 23036 catalog_manager.cc:5495] T da4a85755e5a4f53ba2d785020b0a8e2 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.091442 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fde3f237aa54f24b955c4244224a6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.091574 23036 catalog_manager.cc:5495] T af30e8f4acfb48db875017c1db21f433 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.092998 23036 catalog_manager.cc:5495] T 2ebf05f3933a433cb7201f6c1f9e11c9 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.094077 23036 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (table default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]). Expected version 1 got 0
I20260807 11:09:13.094732 23036 catalog_manager.cc:5495] T ed62b70f86f3457ab0315ff25e836ec6 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.095490 24011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25c60c0060b647d498ca71201bb0936b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.098112 24266 tablet_bootstrap.cc:492] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:13.099645 24008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7574a78a6546b6bf3d51635773b693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.099869 23036 catalog_manager.cc:5495] T 4c7d0cab3da641f4abca60a8beff381e P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.101137 23036 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet 4c7d0cab3da641f4abca60a8beff381e (table default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]). Expected version 1 got 0
I20260807 11:09:13.101752 23036 catalog_manager.cc:5495] T 907f602c4dce41389e06307270c16f71 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.103236 24266 tablet_bootstrap.cc:654] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.103106 23036 catalog_manager.cc:5495] T 4b001bc080a14838a3fc58af982b792b P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.104417 23036 catalog_manager.cc:5495] T d3011806841f46f898920b1a11404f85 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.105468 23036 catalog_manager.cc:5587] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453) does not have the latest schema for tablet d3011806841f46f898920b1a11404f85 (table default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]). Expected version 1 got 0
I20260807 11:09:13.106040 23036 catalog_manager.cc:5495] T 39efd13118454aa983918238928ef2bc P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.107856 23797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25c60c0060b647d498ca71201bb0936b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.111483 23799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7574a78a6546b6bf3d51635773b693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.116967 23807 tablet_service.cc:1467] Processing CreateTablet for tablet 52e6dc2403c149e68985595e5e137dfa (DEFAULT_TABLE table=default.Table_f7407267f0e140289ed791ad730d154f [id=b132fefb831d4870aaddeee3f8e1479f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.116978 23802 tablet_service.cc:1467] Processing CreateTablet for tablet ed5973e2e1b043dbb896d8461a423cae (DEFAULT_TABLE table=default.Table_308433d482ea452289ce2b3d63e5577d [id=93f43cefc3d74c9190ae50d66bcfb3ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.118450 23809 tablet_service.cc:1467] Processing CreateTablet for tablet a65c860297d2421b9c1d0e31497a77af (DEFAULT_TABLE table=default.Table_94689d0c00964dc88800aa0602ac5f73 [id=aa1b402a6ff34987b35696530cf94e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.119664 23807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e6dc2403c149e68985595e5e137dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.122900 23802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed5973e2e1b043dbb896d8461a423cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.123549 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65c860297d2421b9c1d0e31497a77af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.134611 24019 tablet_service.cc:1467] Processing CreateTablet for tablet 52e6dc2403c149e68985595e5e137dfa (DEFAULT_TABLE table=default.Table_f7407267f0e140289ed791ad730d154f [id=b132fefb831d4870aaddeee3f8e1479f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.134882 23036 catalog_manager.cc:5495] T e5685972a6dd45a3806f7a096bffd492 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.135778 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e6dc2403c149e68985595e5e137dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.136294 24017 tablet_service.cc:1467] Processing CreateTablet for tablet a65c860297d2421b9c1d0e31497a77af (DEFAULT_TABLE table=default.Table_94689d0c00964dc88800aa0602ac5f73 [id=aa1b402a6ff34987b35696530cf94e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.137262 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65c860297d2421b9c1d0e31497a77af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.136853 23036 catalog_manager.cc:5495] T f3647d1473454c9ca1c8c2d3441586a2 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.138347 23036 catalog_manager.cc:5495] T da7c92ce240b4bbf8aa2457e5ec0ccb0 P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: UNKNOWN } } }
I20260807 11:09:13.139642 24022 tablet_service.cc:1467] Processing CreateTablet for tablet ed5973e2e1b043dbb896d8461a423cae (DEFAULT_TABLE table=default.Table_308433d482ea452289ce2b3d63e5577d [id=93f43cefc3d74c9190ae50d66bcfb3ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.139847 23036 catalog_manager.cc:5495] T e7aa352ec3434afb81933c3151c3742d P 8a668588fabb4a9eba107cd6020f1e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.140579 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed5973e2e1b043dbb896d8461a423cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.150527 24007 tablet_service.cc:1467] Processing CreateTablet for tablet a7afaa7606884464aa8b376513a466f2 (DEFAULT_TABLE table=default.Table_8aada9f80c114120b9fad92d59976579 [id=86a60d2c4fed45f8b7c1c15ea61847f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.151647 24007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7afaa7606884464aa8b376513a466f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.157543 24021 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0eeeeb7c73470f97bc76566b21e522 (DEFAULT_TABLE table=default.Table_9cc5f868b933436a9237ac18b3aaa690 [id=4b999790160a48d09074af28ebd16079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.157861 24009 tablet_service.cc:1467] Processing CreateTablet for tablet 5b0bf5fcaf764e189506b883d7ba3111 (DEFAULT_TABLE table=default.Table_df4c28e5effb4b60b90f040c46268eb7 [id=5920b1c2aacd403cac2ce78b06a57482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.158665 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0eeeeb7c73470f97bc76566b21e522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.159567 24013 tablet_service.cc:1467] Processing CreateTablet for tablet f8bab6e4fca343ffb1dc8d3da6c0b244 (DEFAULT_TABLE table=default.Table_6d0d642c3b424c3388505b3ba6a6bb25 [id=6684170bb34949e7a0a3e10216b490bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.160502 24013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8bab6e4fca343ffb1dc8d3da6c0b244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.166963 24002 tablet_service.cc:1467] Processing CreateTablet for tablet 3287d6029a09458da24e65c4d802eb92 (DEFAULT_TABLE table=default.Table_087f134702a64647bd34ce9f69e750e8 [id=3cdc318caab3417a9c47ffa7846ada47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.168049 24002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3287d6029a09458da24e65c4d802eb92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.172268 24009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b0bf5fcaf764e189506b883d7ba3111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.191754 24021 tablet_service.cc:1467] Processing CreateTablet for tablet eb6981fd8c9d4d4d8606fc73f7a01d0b (DEFAULT_TABLE table=default.Table_b691ab49ae6a48d4827f493634dc62e7 [id=18d7876a6bec428f8d44a9d68269539a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.192396 24003 tablet_service.cc:1467] Processing CreateTablet for tablet d2994bc5a5b74f40bf0c8a60644f2c25 (DEFAULT_TABLE table=default.Table_81cea7b24eb8462093613254c16693bd [id=0f68d2c639d546d3ac76d6536949e2f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.192987 24021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb6981fd8c9d4d4d8606fc73f7a01d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.196331 24001 tablet_service.cc:1467] Processing CreateTablet for tablet 94fa4bb0de684c50bcba33519866e583 (DEFAULT_TABLE table=default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.197507 24001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fa4bb0de684c50bcba33519866e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.199616 24003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2994bc5a5b74f40bf0c8a60644f2c25. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:09:13.212854 23036 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.22.115.193:60085 (request call id 179) took 929 ms (client timeout 1000 ms). Trace:
I20260807 11:09:13.221441 23808 tablet_service.cc:1467] Processing CreateTablet for tablet a7afaa7606884464aa8b376513a466f2 (DEFAULT_TABLE table=default.Table_8aada9f80c114120b9fad92d59976579 [id=86a60d2c4fed45f8b7c1c15ea61847f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.222515 23808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7afaa7606884464aa8b376513a466f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.231578 23813 tablet_service.cc:1467] Processing CreateTablet for tablet f8bab6e4fca343ffb1dc8d3da6c0b244 (DEFAULT_TABLE table=default.Table_6d0d642c3b424c3388505b3ba6a6bb25 [id=6684170bb34949e7a0a3e10216b490bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.231806 23816 tablet_service.cc:1467] Processing CreateTablet for tablet 5b0bf5fcaf764e189506b883d7ba3111 (DEFAULT_TABLE table=default.Table_df4c28e5effb4b60b90f040c46268eb7 [id=5920b1c2aacd403cac2ce78b06a57482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.232035 23798 tablet_service.cc:1467] Processing CreateTablet for tablet 5e0eeeeb7c73470f97bc76566b21e522 (DEFAULT_TABLE table=default.Table_9cc5f868b933436a9237ac18b3aaa690 [id=4b999790160a48d09074af28ebd16079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.232762 23813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8bab6e4fca343ffb1dc8d3da6c0b244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.233332 23816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b0bf5fcaf764e189506b883d7ba3111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.233894 23798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e0eeeeb7c73470f97bc76566b21e522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.234910 23818 tablet_service.cc:1467] Processing CreateTablet for tablet 3287d6029a09458da24e65c4d802eb92 (DEFAULT_TABLE table=default.Table_087f134702a64647bd34ce9f69e750e8 [id=3cdc318caab3417a9c47ffa7846ada47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.235839 23818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3287d6029a09458da24e65c4d802eb92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 11:09:13.213208 23036 rpcz_store.cc:269] 0807 11:09:12.283866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:12.567537 (+283671us) service_pool.cc:227] Handling call
0807 11:09:13.212778 (+645241us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 11:09:13.159206 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 11:09:13.159648 (+ 442us) write_op.cc:432] Acquiring schema lock in shared mode
0807 11:09:13.159673 (+ 25us) write_op.cc:435] Acquired schema lock
0807 11:09:13.159687 (+ 14us) tablet.cc:660] Decoding operations
0807 11:09:13.161039 (+ 1352us) write_op.cc:620] Acquiring the partition lock for write op
0807 11:09:13.161081 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0807 11:09:13.161111 (+ 30us) tablet.cc:683] Acquiring locks for 19 operations
0807 11:09:13.162304 (+ 1193us) tablet.cc:699] Row locks acquired
0807 11:09:13.162334 (+ 30us) write_op.cc:260] PREPARE: finished
0807 11:09:13.162459 (+ 125us) write_op.cc:270] Start()
0807 11:09:13.162553 (+ 94us) write_op.cc:276] Timestamp: P: 1786100953162411 usec, L: 0
0807 11:09:13.162571 (+ 18us) op_driver.cc:331] REPLICATION: starting
0807 11:09:13.163181 (+ 610us) log.cc:842] Serialized 7431 byte log entry
0807 11:09:13.181457 (+ 18276us) op_driver.cc:444] REPLICATION: finished
0807 11:09:13.181759 (+ 302us) write_op.cc:301] APPLY: starting
0807 11:09:13.181811 (+ 52us) tablet.cc:1365] starting BulkCheckPresence
0807 11:09:13.182189 (+ 378us) tablet.cc:1368] finished BulkCheckPresence
0807 11:09:13.182279 (+ 90us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 11:09:13.183576 (+ 1297us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 11:09:13.183815 (+ 239us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0807 11:09:13.183863 (+ 48us) write_op.cc:312] APPLY: finished
0807 11:09:13.184236 (+ 373us) log.cc:842] Serialized 132 byte log entry
0807 11:09:13.184398 (+ 162us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:09:13.184544 (+ 146us) write_op.cc:454] Released schema lock
0807 11:09:13.184588 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0807 11:09:13.187150 (+ 2562us) write_op.cc:489] Releasing partition, row and schema locks
0807 11:09:13.187179 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3038,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":167,"apply.run_cpu_time_us":3466,"apply.run_wall_time_us":5800,"num_ops":19,"prepare.queue_time_us":884,"prepare.run_cpu_time_us":4343,"prepare.run_wall_time_us":8458,"raft.queue_time_us":1171,"raft.run_cpu_time_us":1668,"raft.run_wall_time_us":1667,"replication_time_us":18810}]]}
I20260807 11:09:13.239060 23805 tablet_service.cc:1467] Processing CreateTablet for tablet eb6981fd8c9d4d4d8606fc73f7a01d0b (DEFAULT_TABLE table=default.Table_b691ab49ae6a48d4827f493634dc62e7 [id=18d7876a6bec428f8d44a9d68269539a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.240132 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb6981fd8c9d4d4d8606fc73f7a01d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.352473 23043 catalog_manager.cc:5495] T 2108b1d026bb42a88f95fef8badb1d77 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.360674 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 2108b1d026bb42a88f95fef8badb1d77 (table default.Table_03c24b5b89614362901773b741bd8b4e [id=5c4a7629628b43dd940b6de0264cb7cd]). Expected version 1 got 0
I20260807 11:09:13.365801 23793 tablet_service.cc:1467] Processing CreateTablet for tablet 94fa4bb0de684c50bcba33519866e583 (DEFAULT_TABLE table=default.Table_141ce43640a7454799d89fade48756e6 [id=3ef9a19e237f46eabb5404d02b9ecee9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.369352 23793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fa4bb0de684c50bcba33519866e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.373617 23794 tablet_service.cc:1467] Processing CreateTablet for tablet d2994bc5a5b74f40bf0c8a60644f2c25 (DEFAULT_TABLE table=default.Table_81cea7b24eb8462093613254c16693bd [id=0f68d2c639d546d3ac76d6536949e2f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:13.375241 23794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2994bc5a5b74f40bf0c8a60644f2c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:13.375299 23043 catalog_manager.cc:5495] T 3733d4813197446e9ecc8be58f87eda7 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 2, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 2 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.376362 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
I20260807 11:09:13.377343 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet d3011806841f46f898920b1a11404f85 (table default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]). Expected version 1 got 0
I20260807 11:09:13.378311 23043 catalog_manager.cc:5495] T 2013df97d54d43aaa844154c200a5a4f P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.395464 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 2013df97d54d43aaa844154c200a5a4f (table default.Table_88d053e473434f119722cfed9e14a700 [id=c905367c134b46c9b29fa3837feae249]). Expected version 1 got 0
I20260807 11:09:13.396373 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet aea90f7a10234f2da4fff089afe87a1e (table default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]). Expected version 1 got 0
I20260807 11:09:13.397032 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 4c7d0cab3da641f4abca60a8beff381e (table default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]). Expected version 1 got 0
I20260807 11:09:13.397709 23043 catalog_manager.cc:5495] T 0d81cc2870864a30a62a20921273d55d P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.429981 25832 tablet_bootstrap.cc:492] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:13.453689 23043 catalog_manager.cc:5495] T 02d17f09961641ca8c4d5a64f0fcadf8 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } }
I20260807 11:09:13.454993 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8]). Expected version 1 got 0
I20260807 11:09:13.455691 23043 catalog_manager.cc:5495] T 06a5e42d83ac4becb19a55d21040a3cc P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } }
I20260807 11:09:13.462673 25832 tablet_bootstrap.cc:654] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.458258 23043 catalog_manager.cc:5495] T 912026edd2664386880028a5958a993c P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.465430 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 912026edd2664386880028a5958a993c (table default.Table_0e391a540a1f4eb09798376daa1dd533 [id=01bc2a49d75f4d11bbbb6a644e2498b3]). Expected version 1 got 0
W20260807 11:09:13.472759 23951 consensus_peers.cc:487] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fb920ddfaaa423387c98112b52fc2e7. This is attempt 6: this message will repeat every 5th retry.
I20260807 11:09:13.473606 23043 catalog_manager.cc:5495] T 88a7cbb316e24dd68127b7e13ad6ae68 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 2, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 2 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.475164 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 6a92aa4664c54114a8816710820e3864 (table default.Table_1ba07f688e5f42a18c6985eaf65e16e1 [id=282f43d738714393ba1c23189d039355]). Expected version 1 got 0
I20260807 11:09:13.475798 23043 catalog_manager.cc:5495] T 9cd1107ba80a4dbeaba696a7b7095423 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } }
I20260807 11:09:13.487141 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 9cd1107ba80a4dbeaba696a7b7095423 (table default.Table_a6db15451abd4a1ca32ce8f2c440b936 [id=9e28a60150c04136b617507a6af99466]). Expected version 1 got 0
I20260807 11:09:13.487960 23043 catalog_manager.cc:5495] T b0ee41a2c21548e7961b3884e8c7a4ff P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } }
I20260807 11:09:13.500679 23043 catalog_manager.cc:5495] T cc48c13644a3401ab34dad398a7f5cd5 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } }
I20260807 11:09:13.507257 25832 tablet_bootstrap.cc:492] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:13.507751 25832 ts_tablet_manager.cc:1397] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.078s user 0.011s sys 0.000s
I20260807 11:09:13.511292 25832 raft_consensus.cc:348] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.517699 23043 catalog_manager.cc:5495] T 738da1d000b4434cb194d91fea4cc6a5 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.524217 25832 raft_consensus.cc:374] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.525283 25832 raft_consensus.cc:729] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.525477 24127 heartbeater.cc:503] Master 127.22.115.254:40237 was elected leader, sending a full tablet report...
I20260807 11:09:13.525899 23043 catalog_manager.cc:5495] T cef5bc28dada49bdada085e87d1f0dab P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.530521 25832 consensus_queue.cc:260] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.539165 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet cef5bc28dada49bdada085e87d1f0dab (table default.Table_f343bd15113d474ba791135714036936 [id=3a6709ec839444279264e56e47b6a0d7]). Expected version 1 got 0
I20260807 11:09:13.540946 25832 ts_tablet_manager.cc:1428] T ed5973e2e1b043dbb896d8461a423cae P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260807 11:09:13.541949 23043 catalog_manager.cc:5495] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to c281254655c84a0496c50045c37b22df (127.22.115.195). New cstate: current_term: 1 leader_uuid: "c281254655c84a0496c50045c37b22df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.551659 23043 catalog_manager.cc:5495] T f36b812880814298990c9aee6999f113 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } }
I20260807 11:09:13.557556 25832 tablet_bootstrap.cc:492] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:13.563587 25832 tablet_bootstrap.cc:654] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.564141 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet f36b812880814298990c9aee6999f113 (table default.Table_3e30bbe8a73348c2a9af2b1e51fbe2f5 [id=9e5c4d1a3cc44af8a5067e542f7a4445]). Expected version 1 got 0
I20260807 11:09:13.564898 23043 catalog_manager.cc:5495] T a20f0ba778a14d71b9e5efa113c784ff P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.566099 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet a20f0ba778a14d71b9e5efa113c784ff (table default.Table_3d3d2c64ef784197815a34510666c5df [id=91a12abc12694046b152c42fedd52521]). Expected version 1 got 0
I20260807 11:09:13.587095 23043 catalog_manager.cc:5495] T dde5287f17a944708d7678c57bf37bf9 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
I20260807 11:09:13.588362 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet dde5287f17a944708d7678c57bf37bf9 (table default.Table_a46f408876e040f7abc059e728d04a9c [id=d8165adfe8ce4053b5b35900f89cd0de]). Expected version 2 got 0
I20260807 11:09:13.589107 23043 catalog_manager.cc:5495] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to c281254655c84a0496c50045c37b22df (127.22.115.195). New cstate: current_term: 1 leader_uuid: "c281254655c84a0496c50045c37b22df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.590339 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 64c4a0700315457384e3ca995de8a4f2 (table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63]). Expected version 2 got 0
I20260807 11:09:13.606349 23043 catalog_manager.cc:5495] T cc36c0c8fded4ac6991b98c132b17e56 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8a668588fabb4a9eba107cd6020f1e93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } }
W20260807 11:09:13.608362 24558 connection.cc:535] server connection from 127.22.115.193:60519 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 11:09:13.609140 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet cc36c0c8fded4ac6991b98c132b17e56 (table default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484]). Expected version 1 got 0
W20260807 11:09:13.611133 23745 connection.cc:535] client connection to 127.22.115.193:37453 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:13.611593 23745 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:13.617261 23953 connection.cc:535] server connection from 127.22.115.193:35959 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:13.618141 23739 connection.cc:535] server connection from 127.22.115.193:53803 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:13.619067 23954 connection.cc:535] client connection to 127.22.115.193:37453 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:13.619457 23954 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 11:09:13.620193 24266 tablet_bootstrap.cc:492] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:13.620625 24266 ts_tablet_manager.cc:1397] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.523s user 0.122s sys 0.088s
I20260807 11:09:13.623216 25832 tablet_bootstrap.cc:492] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:13.623679 25832 ts_tablet_manager.cc:1397] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.002s
I20260807 11:09:13.626168 25832 raft_consensus.cc:348] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.626910 25832 raft_consensus.cc:374] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.627213 25832 raft_consensus.cc:729] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.627689 25230 raft_consensus.cc:482] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:13.627853 25832 consensus_queue.cc:260] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.628099 25230 raft_consensus.cc:504] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:13.630101 25230 leader_election.cc:288] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:13.630228 25832 ts_tablet_manager.cc:1428] T f8bab6e4fca343ffb1dc8d3da6c0b244 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
W20260807 11:09:13.630298 23027 connection.cc:535] server connection from 127.22.115.193:60085 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 11:09:13.634599 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f0b6867c524174a48a92758e566a95" candidate_uuid: "c281254655c84a0496c50045c37b22df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" is_pre_election: true
I20260807 11:09:13.635247 23840 raft_consensus.cc:2379] T 81f0b6867c524174a48a92758e566a95 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c281254655c84a0496c50045c37b22df in current term 1: Already voted for candidate 8a668588fabb4a9eba107cd6020f1e93 in this term.
W20260807 11:09:13.639160 23030 connection.cc:535] client connection to 127.22.115.193:37453 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:13.639616 23030 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 6 similar messages]
I20260807 11:09:13.650367 25832 tablet_bootstrap.cc:492] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
I20260807 11:09:13.656241 25832 tablet_bootstrap.cc:654] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.658661 24266 raft_consensus.cc:348] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.659384 24266 raft_consensus.cc:374] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.659632 24266 raft_consensus.cc:729] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.660215 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (table default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]). Expected version 1 got 0
I20260807 11:09:13.661939 24266 consensus_queue.cc:260] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.680650 25832 tablet_bootstrap.cc:492] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011: No bootstrap required, opened a new log
I20260807 11:09:13.681102 25832 ts_tablet_manager.cc:1397] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.005s
I20260807 11:09:13.683635 25832 raft_consensus.cc:348] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.684506 25832 raft_consensus.cc:374] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.684598 24266 ts_tablet_manager.cc:1428] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.064s user 0.007s sys 0.000s
I20260807 11:09:13.684857 25832 raft_consensus.cc:729] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99a8d4e2c1b14150b03ad0f28e74a011, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.685545 25832 consensus_queue.cc:260] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.688653 25832 ts_tablet_manager.cc:1428] T 3287d6029a09458da24e65c4d802eb92 P 99a8d4e2c1b14150b03ad0f28e74a011: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260807 11:09:13.689591 25832 tablet_bootstrap.cc:492] T a65c860297d2421b9c1d0e31497a77af P 99a8d4e2c1b14150b03ad0f28e74a011: Bootstrap starting.
W20260807 11:09:13.698995 23745 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 87443.6us
I20260807 11:09:13.700153 24266 tablet_bootstrap.cc:492] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:09:13.704383 23030 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 64772.4us
I20260807 11:09:13.713104 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 23703
W20260807 11:09:13.718742 23954 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.115.193:37453, user_credentials={real_user=slave}} blocked reactor thread for 99325.7us
I20260807 11:09:13.663898 23043 catalog_manager.cc:5495] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df reported cstate change: term changed from 0 to 1, leader changed from <none> to c281254655c84a0496c50045c37b22df (127.22.115.195). New cstate: current_term: 1 leader_uuid: "c281254655c84a0496c50045c37b22df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:13.722373 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet fb1504be4320471687d86a55a9891081 (table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]). Expected version 1 got 0
I20260807 11:09:13.723479 23043 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 4e965a1dc66c414285df6727d2982e12 (table default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d]). Expected version 1 got 0
I20260807 11:09:13.726660 24266 tablet_bootstrap.cc:654] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.737371 24266 tablet_bootstrap.cc:492] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:13.737751 24266 ts_tablet_manager.cc:1397] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.009s
I20260807 11:09:13.739938 24266 raft_consensus.cc:348] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.740566 24266 raft_consensus.cc:374] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.740780 24266 raft_consensus.cc:729] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.741293 24266 consensus_queue.cc:260] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.743253 24266 ts_tablet_manager.cc:1428] T 5e0eeeeb7c73470f97bc76566b21e522 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
W20260807 11:09:13.761926 23030 catalog_manager.cc:4584] TS 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b62eea967fed4adc84252b8366609878: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111)
W20260807 11:09:13.777773 23954 consensus_peers.cc:487] T fb1504be4320471687d86a55a9891081 P c281254655c84a0496c50045c37b22df -> Peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Couldn't send request to peer 8a668588fabb4a9eba107cd6020f1e93. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:13.778373 23954 leader_election.cc:334] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111)
I20260807 11:09:13.778824 23954 leader_election.cc:302] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:13.779570 25230 raft_consensus.cc:3037] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:13.785773 25230 raft_consensus.cc:2726] T 741fdb38a64c4e63a6efc447c6f5ca1f P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:09:13.786543 23954 consensus_peers.cc:487] T 5fb920ddfaaa423387c98112b52fc2e7 P c281254655c84a0496c50045c37b22df -> Peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Couldn't send request to peer 8a668588fabb4a9eba107cd6020f1e93. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:13.787024 23954 consensus_peers.cc:487] T d78ed82613064935919934df7124d707 P c281254655c84a0496c50045c37b22df -> Peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Couldn't send request to peer 8a668588fabb4a9eba107cd6020f1e93. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:13.787424 23954 consensus_peers.cc:487] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df -> Peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Couldn't send request to peer 8a668588fabb4a9eba107cd6020f1e93. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:13.787829 23954 consensus_peers.cc:487] T 64cb221021564d66bfecf5cd91bcec5c P c281254655c84a0496c50045c37b22df -> Peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Couldn't send request to peer 8a668588fabb4a9eba107cd6020f1e93. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:13.788241 23954 consensus_peers.cc:487] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df -> Peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Couldn't send request to peer 8a668588fabb4a9eba107cd6020f1e93. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:13.788646 23954 consensus_peers.cc:487] T 64c4a0700315457384e3ca995de8a4f2 P c281254655c84a0496c50045c37b22df -> Peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Couldn't send request to peer 8a668588fabb4a9eba107cd6020f1e93. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:13.791582 23954 leader_election.cc:334] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111)
I20260807 11:09:13.791970 23954 leader_election.cc:302] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:13.792598 25230 raft_consensus.cc:3037] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:13.793895 24266 tablet_bootstrap.cc:492] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:13.797773 25230 raft_consensus.cc:2726] T 81f0b6867c524174a48a92758e566a95 P c281254655c84a0496c50045c37b22df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:13.811403 24266 tablet_bootstrap.cc:654] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.847566 24266 tablet_bootstrap.cc:492] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:13.848071 24266 ts_tablet_manager.cc:1397] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.054s user 0.010s sys 0.000s
I20260807 11:09:13.850301 24266 raft_consensus.cc:348] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.859313 24266 raft_consensus.cc:374] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.860196 24266 raft_consensus.cc:729] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.860848 24266 consensus_queue.cc:260] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.867779 24266 ts_tablet_manager.cc:1428] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260807 11:09:13.868688 24266 tablet_bootstrap.cc:492] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:13.880061 24266 tablet_bootstrap.cc:654] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.919512 24266 tablet_bootstrap.cc:492] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:13.919947 24266 ts_tablet_manager.cc:1397] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.051s user 0.020s sys 0.012s
I20260807 11:09:13.922011 24266 raft_consensus.cc:348] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.922616 24266 raft_consensus.cc:374] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.922839 24266 raft_consensus.cc:729] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.923401 24266 consensus_queue.cc:260] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
W20260807 11:09:13.924831 23027 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2108b1d026bb42a88f95fef8badb1d77 (table default.Table_03c24b5b89614362901773b741bd8b4e [id=5c4a7629628b43dd940b6de0264cb7cd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2108b1d026bb42a88f95fef8badb1d77 consensus state has no leader
I20260807 11:09:13.948558 24266 ts_tablet_manager.cc:1428] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.028s user 0.004s sys 0.000s
I20260807 11:09:13.972376 24266 tablet_bootstrap.cc:492] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:13.977385 24266 tablet_bootstrap.cc:654] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:13.985224 25848 raft_consensus.cc:482] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:13.985671 25848 raft_consensus.cc:504] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } }
I20260807 11:09:13.987998 25848 leader_election.cc:288] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
I20260807 11:09:13.990479 24266 tablet_bootstrap.cc:492] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:13.990878 24266 ts_tablet_manager.cc:1397] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.004s
I20260807 11:09:13.992925 24266 raft_consensus.cc:348] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.993525 24266 raft_consensus.cc:374] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:13.993753 24266 raft_consensus.cc:729] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:13.994256 24266 consensus_queue.cc:260] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:13.995616 24266 ts_tablet_manager.cc:1428] T eb6981fd8c9d4d4d8606fc73f7a01d0b P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 11:09:13.996364 24266 tablet_bootstrap.cc:492] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:09:13.997300 23954 leader_election.cc:334] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111)
I20260807 11:09:14.005028 24266 tablet_bootstrap.cc:654] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:14.069079 24266 tablet_bootstrap.cc:492] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:14.069483 24266 ts_tablet_manager.cc:1397] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.000s
I20260807 11:09:14.078745 25230 raft_consensus.cc:482] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:14.079135 24266 raft_consensus.cc:348] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:14.079797 24266 raft_consensus.cc:374] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:14.080015 24266 raft_consensus.cc:729] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:14.080559 24266 consensus_queue.cc:260] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:14.082492 24266 ts_tablet_manager.cc:1428] T 6fde3f237aa54f24b955c4244224a6ea P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260807 11:09:14.079144 25230 raft_consensus.cc:504] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:14.084867 25230 leader_election.cc:288] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:14.089399 23954 leader_election.cc:334] T b53e85597f6e44f08e3076d2622d44c3 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111)
I20260807 11:09:14.103390 24266 tablet_bootstrap.cc:492] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df: Bootstrap starting.
I20260807 11:09:14.104346 25850 raft_consensus.cc:482] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:14.104779 25850 raft_consensus.cc:504] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:14.106698 25850 leader_election.cc:288] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497), 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453)
W20260807 11:09:14.114460 23954 leader_election.cc:334] T f8bab6e4fca343ffb1dc8d3da6c0b244 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111)
I20260807 11:09:14.140245 24266 tablet_bootstrap.cc:654] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:14.168310 25850 raft_consensus.cc:482] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:14.168807 25850 raft_consensus.cc:504] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:14.170703 25850 leader_election.cc:288] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453), 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497)
W20260807 11:09:14.175482 23954 leader_election.cc:334] T 52e6dc2403c149e68985595e5e137dfa P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 8a668588fabb4a9eba107cd6020f1e93 (127.22.115.193:37453): Network error: Client connection negotiation failed: client connection to 127.22.115.193:37453: connect: Connection refused (error 111)
I20260807 11:09:14.180553 24266 tablet_bootstrap.cc:492] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df: No bootstrap required, opened a new log
I20260807 11:09:14.180976 24266 ts_tablet_manager.cc:1397] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df: Time spent bootstrapping tablet: real 0.078s user 0.007s sys 0.001s
I20260807 11:09:14.183255 24266 raft_consensus.cc:348] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:14.183900 24266 raft_consensus.cc:374] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:14.184136 24266 raft_consensus.cc:729] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c281254655c84a0496c50045c37b22df, State: Initialized, Role: FOLLOWER
I20260807 11:09:14.184773 24266 consensus_queue.cc:260] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } } peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } }
I20260807 11:09:14.193092 24266 ts_tablet_manager.cc:1428] T a65c860297d2421b9c1d0e31497a77af P c281254655c84a0496c50045c37b22df: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260807 11:09:14.193885 24266 tablet_bootstrap.cc:492] T ed5973e2e1b043dbb896d8461a423cae P c281254655c84a0496c50045c37b22df: Bootstrap starting.
W20260807 11:09:14.225168 23142 connection.cc:535] server connection from 127.22.115.194:34929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:14.225997 23951 connection.cc:535] client connection to 127.22.115.194:39497 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 11:09:14.233410 24266 tablet_bootstrap.cc:654] T ed5973e2e1b043dbb896d8461a423cae P c281254655c84a0496c50045c37b22df: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:14.236618 23951 consensus_peers.cc:466] T 84c78502f0a5485c9ffe4434c14567e0 P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.22.115.194:39497: connect: Connection refused (error 111)
W20260807 11:09:14.236927 23951 consensus_peers.cc:487] T 9c4f1adf1fb9450cba3de70397beaa2b P c281254655c84a0496c50045c37b22df -> Peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Couldn't send request to peer 99a8d4e2c1b14150b03ad0f28e74a011. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.194:39497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 11:09:14.237244 23951 leader_election.cc:334] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497): Network error: Client connection negotiation failed: client connection to 127.22.115.194:39497: connect: Connection refused (error 111)
I20260807 11:09:14.237576 23951 leader_election.cc:302] T 5eaf45dad4a944dab77330db6fc53222 P c281254655c84a0496c50045c37b22df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c281254655c84a0496c50045c37b22df; no voters: 8a668588fabb4a9eba107cd6020f1e93, 99a8d4e2c1b14150b03ad0f28e74a011
I20260807 11:09:14.237847 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 23922
I20260807 11:09:14.267205 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
I20260807 11:09:14.268451 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 64c4a0700315457384e3ca995de8a4f2 (table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63]). Expected version 2 got 0
I20260807 11:09:14.269043 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 2108b1d026bb42a88f95fef8badb1d77 (table default.Table_03c24b5b89614362901773b741bd8b4e [id=5c4a7629628b43dd940b6de0264cb7cd]). Expected version 1 got 0
I20260807 11:09:14.269589 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet cc36c0c8fded4ac6991b98c132b17e56 (table default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484]). Expected version 1 got 0
I20260807 11:09:14.269966 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 2013df97d54d43aaa844154c200a5a4f (table default.Table_88d053e473434f119722cfed9e14a700 [id=c905367c134b46c9b29fa3837feae249]). Expected version 1 got 0
I20260807 11:09:14.270466 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8]). Expected version 1 got 0
I20260807 11:09:14.271273 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet dde5287f17a944708d7678c57bf37bf9 (table default.Table_a46f408876e040f7abc059e728d04a9c [id=d8165adfe8ce4053b5b35900f89cd0de]). Expected version 2 got 0
I20260807 11:09:14.271937 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 6a92aa4664c54114a8816710820e3864 (table default.Table_1ba07f688e5f42a18c6985eaf65e16e1 [id=282f43d738714393ba1c23189d039355]). Expected version 1 got 0
I20260807 11:09:14.272830 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 9cd1107ba80a4dbeaba696a7b7095423 (table default.Table_a6db15451abd4a1ca32ce8f2c440b936 [id=9e28a60150c04136b617507a6af99466]). Expected version 1 got 0
I20260807 11:09:14.273409 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet f36b812880814298990c9aee6999f113 (table default.Table_3e30bbe8a73348c2a9af2b1e51fbe2f5 [id=9e5c4d1a3cc44af8a5067e542f7a4445]). Expected version 1 got 0
I20260807 11:09:14.273972 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet a20f0ba778a14d71b9e5efa113c784ff (table default.Table_3d3d2c64ef784197815a34510666c5df [id=91a12abc12694046b152c42fedd52521]). Expected version 1 got 0
I20260807 11:09:14.274631 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet cef5bc28dada49bdada085e87d1f0dab (table default.Table_f343bd15113d474ba791135714036936 [id=3a6709ec839444279264e56e47b6a0d7]). Expected version 1 got 0
I20260807 11:09:14.276065 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 4e965a1dc66c414285df6727d2982e12 (table default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d]). Expected version 1 got 0
I20260807 11:09:14.276625 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 912026edd2664386880028a5958a993c (table default.Table_0e391a540a1f4eb09798376daa1dd533 [id=01bc2a49d75f4d11bbbb6a644e2498b3]). Expected version 1 got 0
I20260807 11:09:14.277448 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet d3011806841f46f898920b1a11404f85 (table default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]). Expected version 1 got 0
I20260807 11:09:14.278115 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (table default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]). Expected version 1 got 0
I20260807 11:09:14.278625 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet aea90f7a10234f2da4fff089afe87a1e (table default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]). Expected version 1 got 0
I20260807 11:09:14.279009 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet fb1504be4320471687d86a55a9891081 (table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]). Expected version 1 got 0
I20260807 11:09:14.279439 23048 catalog_manager.cc:5495] T c5dfdf237bab4aefbd1a45325d741cf5 P 99a8d4e2c1b14150b03ad0f28e74a011 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194). New cstate: current_term: 1 leader_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c281254655c84a0496c50045c37b22df" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 36683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a668588fabb4a9eba107cd6020f1e93" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99a8d4e2c1b14150b03ad0f28e74a011" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 39497 } health_report { overall_health: HEALTHY } } }
I20260807 11:09:14.280475 23048 catalog_manager.cc:5587] TS 99a8d4e2c1b14150b03ad0f28e74a011 (127.22.115.194:39497) does not have the latest schema for tablet 4c7d0cab3da641f4abca60a8beff381e (table default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]). Expected version 1 got 0
I20260807 11:09:14.334913 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 2108b1d026bb42a88f95fef8badb1d77 (table default.Table_03c24b5b89614362901773b741bd8b4e [id=5c4a7629628b43dd940b6de0264cb7cd]). Expected version 1 got 0
I20260807 11:09:14.335671 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 3733d4813197446e9ecc8be58f87eda7 (table default.Table_c22be7feb1a54be89a486e34ca9c7194 [id=83e365e8f3f94f6b869152057a8d7212]). Expected version 1 got 0
I20260807 11:09:14.337488 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet d3011806841f46f898920b1a11404f85 (table default.Table_25a3c70d458646fcaef373ad6e90dd75 [id=7f4a96e7eb4c465d8e4d6b1fb1209beb]). Expected version 1 got 0
I20260807 11:09:14.338696 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 2013df97d54d43aaa844154c200a5a4f (table default.Table_88d053e473434f119722cfed9e14a700 [id=c905367c134b46c9b29fa3837feae249]). Expected version 1 got 0
I20260807 11:09:14.339874 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet aea90f7a10234f2da4fff089afe87a1e (table default.Table_34d9c6fae3824bf59327e55bbfbff7ae [id=cefda77bb14946c0a8112d6eb91c10d3]). Expected version 1 got 0
I20260807 11:09:14.341408 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 4c7d0cab3da641f4abca60a8beff381e (table default.Table_dd11d15b474c4c79bc79b7ad57408040 [id=6c36986526a34546a7b2f877ea2fa96e]). Expected version 1 got 0
I20260807 11:09:14.342355 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 02d17f09961641ca8c4d5a64f0fcadf8 (table default.Table_e8859f873e364b658e467328cee6a965 [id=b8610b899c874bbc8b3981a50df6e6b8]). Expected version 1 got 0
I20260807 11:09:14.343142 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 912026edd2664386880028a5958a993c (table default.Table_0e391a540a1f4eb09798376daa1dd533 [id=01bc2a49d75f4d11bbbb6a644e2498b3]). Expected version 1 got 0
I20260807 11:09:14.345156 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 6a92aa4664c54114a8816710820e3864 (table default.Table_1ba07f688e5f42a18c6985eaf65e16e1 [id=282f43d738714393ba1c23189d039355]). Expected version 1 got 0
I20260807 11:09:14.345732 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 9cd1107ba80a4dbeaba696a7b7095423 (table default.Table_a6db15451abd4a1ca32ce8f2c440b936 [id=9e28a60150c04136b617507a6af99466]). Expected version 1 got 0
I20260807 11:09:14.347113 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet cef5bc28dada49bdada085e87d1f0dab (table default.Table_f343bd15113d474ba791135714036936 [id=3a6709ec839444279264e56e47b6a0d7]). Expected version 1 got 0
I20260807 11:09:14.347661 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet cc36c0c8fded4ac6991b98c132b17e56 (table default.Table_cf7d4147464e42238a2e055d3e1d9dc7 [id=42cb6ca0222e4c8ea6690b1bddec8484]). Expected version 1 got 0
I20260807 11:09:14.348105 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet f36b812880814298990c9aee6999f113 (table default.Table_3e30bbe8a73348c2a9af2b1e51fbe2f5 [id=9e5c4d1a3cc44af8a5067e542f7a4445]). Expected version 1 got 0
I20260807 11:09:14.348469 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet a20f0ba778a14d71b9e5efa113c784ff (table default.Table_3d3d2c64ef784197815a34510666c5df [id=91a12abc12694046b152c42fedd52521]). Expected version 1 got 0
I20260807 11:09:14.348981 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet dde5287f17a944708d7678c57bf37bf9 (table default.Table_a46f408876e040f7abc059e728d04a9c [id=d8165adfe8ce4053b5b35900f89cd0de]). Expected version 2 got 0
I20260807 11:09:14.349418 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 64c4a0700315457384e3ca995de8a4f2 (table default.Table_cd586de57a6548dd85d7c3d40654cf90 [id=f7b5878fb01e49a5baf112e8b0a11e63]). Expected version 2 got 0
I20260807 11:09:14.350368 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 2ebf05f3933a433cb7201f6c1f9e11c9 (table default.Table_a7f137ab9e544641bdbf49dbee0a220e [id=df35f6bfbc944afa91bdbb4760a23bd7]). Expected version 1 got 0
I20260807 11:09:14.350901 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet fb1504be4320471687d86a55a9891081 (table default.Table_93c716a578c941d3806babb08030b273 [id=6eac62be2b864055a748ec2e383186e5]). Expected version 1 got 0
I20260807 11:09:14.351493 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet 4e965a1dc66c414285df6727d2982e12 (table default.Table_bec911c7a8ae4fed9cb275b53592d0fd [id=408788b687bd4e6192bc585c66a1027d]). Expected version 1 got 0
I20260807 11:09:14.352385 23036 catalog_manager.cc:5587] TS c281254655c84a0496c50045c37b22df (127.22.115.195:36683) does not have the latest schema for tablet b53e85597f6e44f08e3076d2622d44c3 (table default.Table_9c4a12ea275143bc997a974a47ac3352 [id=efebaf241d40428db31da62407816203]). Expected version 1 got 0
I20260807 11:09:14.353125 23043 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e598bda106e4ec181b53fc7f305c822: default.Table_d9bd2b2348cb4614a4bd7c207186a696 [id=97fa5c597042473aac2865ebebf63541] alter complete (version 3)
W20260807 11:09:14.369159 23030 connection.cc:535] client connection to 127.22.115.195:36683 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 11:09:14.375686 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 23003
I20260807 11:09:14.443719 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 23102
I20260807 11:09:14.486541 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 24232
2026-08-07T11:09:14Z chronyd exiting
I20260807 11:09:14.551517 22991 master-stress-test.cc:586] Tables created: 111
I20260807 11:09:14.551730 22991 master-stress-test.cc:587] Tables altered: 56
I20260807 11:09:14.551872 22991 master-stress-test.cc:588] Tables deleted: 45
I20260807 11:09:14.552019 22991 master-stress-test.cc:589] Tablets replaced: 20
I20260807 11:09:14.552157 22991 master-stress-test.cc:590] Masters restarted: 1
[ OK ] CatalogManagerConfigurations/MasterStressTest.Test/0 (49780 ms)
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/3
I20260807 11:09:14.639518 22991 test_util.cc:268] Using random seed: 149892227
2026-08-07T11:09:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T11:09:14Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskijOH_9/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskijOH_9/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/security.properties
2026-08-07 11:09:20: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskijOH_9/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskijOH_9/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260807 11:09:29.189270 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.254:33273
--webserver_interface=127.22.115.254
--webserver_port=0
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--hive_metastore_uris=thrift://127.0.0.1:45587
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260807 11:09:29.497922 26211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:29.498530 26211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:29.499003 26211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:09:29.530378 26211 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260807 11:09:29.530638 26211 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260807 11:09:29.530833 26211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:09:29.531044 26211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:29.531240 26211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:09:29.531423 26211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:09:29.575313 26211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:45587
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.254:33273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.115.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:29.576719 26211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:29.578679 26211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:09:29.600615 26221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:29.601328 26220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:29.606833 26224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:30.699678 26223 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260807 11:09:30.699724 26211 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260807 11:09:30.703610 26211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:30.706259 26211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:30.707640 26211 hybrid_clock.cc:648] HybridClock initialized: now 1786100970707605 us; error 40 us; skew 500 ppm
I20260807 11:09:30.708474 26211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:30.715027 26211 webserver.cc:460] Webserver started at http://127.22.115.254:37277/ using document root <none> and password file <none>
I20260807 11:09:30.715935 26211 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:30.716151 26211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:30.716632 26211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:09:30.721654 26211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/instance:
uuid: "6ef9afb7003a447087f387b3eab9ee86"
format_stamp: "Formatted at 2026-08-07 11:09:30 on dist-test-slave-5bn2"
I20260807 11:09:30.722774 26211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal/instance:
uuid: "6ef9afb7003a447087f387b3eab9ee86"
format_stamp: "Formatted at 2026-08-07 11:09:30 on dist-test-slave-5bn2"
I20260807 11:09:30.730293 26211 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260807 11:09:30.736104 26235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:30.737105 26211 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.005s
I20260807 11:09:30.737458 26211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
uuid: "6ef9afb7003a447087f387b3eab9ee86"
format_stamp: "Formatted at 2026-08-07 11:09:30 on dist-test-slave-5bn2"
I20260807 11:09:30.737805 26211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:30.769723 26211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:30.771304 26211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:30.771770 26211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:30.845257 26211 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.254:33273
I20260807 11:09:30.845335 26316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.254:33273 every 8 connection(s)
I20260807 11:09:30.848026 26211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
I20260807 11:09:30.853094 26317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:30.858446 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 26211
I20260807 11:09:30.858974 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal/instance
I20260807 11:09:30.862629 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.253:45313
--webserver_interface=127.22.115.253
--webserver_port=0
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--hive_metastore_uris=thrift://127.0.0.1:45587
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260807 11:09:30.867507 26317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:09:30.896659 26317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } has no permanent_uuid. Determining permanent_uuid...
W20260807 11:09:30.899398 26237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:30.903380 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:30.952988 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } attempt: 1
W20260807 11:09:30.957002 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:31.025456 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } attempt: 2
W20260807 11:09:31.029168 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:31.120645 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } attempt: 3
W20260807 11:09:31.124320 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:31.178925 26321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:31.179473 26321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:31.179874 26321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:09:31.210928 26321 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260807 11:09:31.211181 26321 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260807 11:09:31.211375 26321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:09:31.211597 26321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:31.211848 26321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:09:31.212052 26321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:09:31.249532 26321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:45587
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.253:45313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.115.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:31.250731 26321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:31.252382 26321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 11:09:31.267776 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } attempt: 4
W20260807 11:09:31.270908 26332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:31.273020 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:31.572479 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } attempt: 5
W20260807 11:09:31.576889 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:32.124341 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } attempt: 6
W20260807 11:09:32.138252 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:31.272070 26334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:31.270925 26331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:32.369119 26333 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260807 11:09:32.369240 26321 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260807 11:09:32.372771 26321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:32.375805 26321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:32.377328 26321 hybrid_clock.cc:648] HybridClock initialized: now 1786100972377297 us; error 48 us; skew 500 ppm
I20260807 11:09:32.378208 26321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:32.385092 26321 webserver.cc:460] Webserver started at http://127.22.115.253:35743/ using document root <none> and password file <none>
I20260807 11:09:32.386016 26321 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:32.386209 26321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:32.386633 26321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:09:32.391651 26321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data/instance:
uuid: "79d274e2557344d4a38dfb83e8438d1a"
format_stamp: "Formatted at 2026-08-07 11:09:32 on dist-test-slave-5bn2"
I20260807 11:09:32.392733 26321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/wal/instance:
uuid: "79d274e2557344d4a38dfb83e8438d1a"
format_stamp: "Formatted at 2026-08-07 11:09:32 on dist-test-slave-5bn2"
I20260807 11:09:32.399998 26321 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 11:09:32.405577 26347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:32.406632 26321 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 11:09:32.406960 26321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/wal
uuid: "79d274e2557344d4a38dfb83e8438d1a"
format_stamp: "Formatted at 2026-08-07 11:09:32 on dist-test-slave-5bn2"
I20260807 11:09:32.407281 26321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:32.442044 26321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:32.443578 26321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:32.443988 26321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:32.514670 26321 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.253:45313
I20260807 11:09:32.514772 26424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.253:45313 every 8 connection(s)
I20260807 11:09:32.517473 26321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/data/info.pb
I20260807 11:09:32.522719 26427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:32.526499 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 26321
I20260807 11:09:32.526971 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-1/wal/instance
I20260807 11:09:32.529412 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:37249
--webserver_interface=127.22.115.252
--webserver_port=0
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--hive_metastore_uris=thrift://127.0.0.1:45587
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260807 11:09:32.534466 26427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:09:32.559717 26427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:09:32.576644 26427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
W20260807 11:09:32.579236 26352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:09:32.583482 26427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:32.632953 26427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 1
W20260807 11:09:32.636772 26427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:32.705163 26427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 2
W20260807 11:09:32.709098 26427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:32.800518 26427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 3
W20260807 11:09:32.804584 26427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:09:32.857088 26428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:32.857712 26428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:32.858168 26428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:09:32.889456 26428 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260807 11:09:32.889724 26428 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260807 11:09:32.889989 26428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:09:32.890249 26428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:32.890482 26428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:09:32.890715 26428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:09:32.926134 26428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:45587
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:37249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.115.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:32.927476 26428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:32.929108 26428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:09:32.946321 26443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:32.947945 26427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 4
W20260807 11:09:32.951431 26427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.198877 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } attempt: 7
I20260807 11:09:33.213577 26317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
W20260807 11:09:33.219084 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.250804 26427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 5
W20260807 11:09:33.254885 26427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.277483 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 1
W20260807 11:09:33.281394 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.362802 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 2
W20260807 11:09:33.366981 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.452381 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 3
W20260807 11:09:33.456557 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.596980 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 4
W20260807 11:09:33.601425 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.802301 26427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 6
W20260807 11:09:33.809595 26427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:33.884804 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 5
W20260807 11:09:33.888686 26317 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.115.252:37249: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:09:32.946324 26448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:32.946478 26442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:32.948077 26428 server_base.cc:1034] running on GCE node
I20260807 11:09:34.053476 26428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:34.056674 26428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:34.058113 26428 hybrid_clock.cc:648] HybridClock initialized: now 1786100974058071 us; error 59 us; skew 500 ppm
I20260807 11:09:34.059000 26428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:34.065778 26428 webserver.cc:460] Webserver started at http://127.22.115.252:38673/ using document root <none> and password file <none>
I20260807 11:09:34.066702 26428 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:34.066947 26428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:34.067407 26428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:09:34.072413 26428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/instance:
uuid: "fda42d40a62841349371a2ca0bd85a37"
format_stamp: "Formatted at 2026-08-07 11:09:34 on dist-test-slave-5bn2"
I20260807 11:09:34.073721 26428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal/instance:
uuid: "fda42d40a62841349371a2ca0bd85a37"
format_stamp: "Formatted at 2026-08-07 11:09:34 on dist-test-slave-5bn2"
I20260807 11:09:34.080849 26428 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260807 11:09:34.086427 26464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:34.087591 26428 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 11:09:34.087900 26428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
uuid: "fda42d40a62841349371a2ca0bd85a37"
format_stamp: "Formatted at 2026-08-07 11:09:34 on dist-test-slave-5bn2"
I20260807 11:09:34.088238 26428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:34.121014 26428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:34.122505 26428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:34.122968 26428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:34.193464 26428 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.252:37249
I20260807 11:09:34.193559 26531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.252:37249 every 8 connection(s)
I20260807 11:09:34.196413 26428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
I20260807 11:09:34.199728 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 26428
I20260807 11:09:34.200191 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal/instance
I20260807 11:09:34.201687 26532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:34.219029 26532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:09:34.244620 26532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:09:34.256429 26532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } has no permanent_uuid. Determining permanent_uuid...
I20260807 11:09:34.273886 26532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Bootstrap starting.
I20260807 11:09:34.280000 26532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:34.281769 26532 log.cc:824] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Log is configured to *not* fsync() on all Append() calls
I20260807 11:09:34.286309 26532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: No bootstrap required, opened a new log
I20260807 11:09:34.306685 26532 raft_consensus.cc:348] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:34.307353 26532 raft_consensus.cc:374] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:34.307586 26532 raft_consensus.cc:729] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda42d40a62841349371a2ca0bd85a37, State: Initialized, Role: FOLLOWER
I20260807 11:09:34.308295 26532 consensus_queue.cc:260] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:34.310747 26544 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:34.311501 26544 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:34.312067 26532 sys_catalog.cc:564] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 11:09:34.343045 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.343511 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 11:09:34.357885 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.358332 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.337523 26428 master_runner.cc:186] Error getting master registration for 127.22.115.254:33273: OK, instance_id { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" instance_seqno: 1786100970824862 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260807 11:09:34.372601 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 11:09:34.372867 26428 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:09:34.372990 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 11:09:34.378270 26474 tablet.cc:2369] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 11:09:34.387648 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.388073 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 11:09:34.401057 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.401290 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.415870 26544 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:34.416427 26544 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
W20260807 11:09:34.417348 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.417708 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.421039 26544 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
W20260807 11:09:34.431842 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.432143 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.441035 26317 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 6
W20260807 11:09:34.447685 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.447976 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 11:09:34.462148 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.462464 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.464537 26317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Bootstrap starting.
W20260807 11:09:34.477030 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.478142 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.485185 26317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:34.487627 26317 log.cc:824] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Log is configured to *not* fsync() on all Append() calls
W20260807 11:09:34.492316 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.492724 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.493248 26317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: No bootstrap required, opened a new log
W20260807 11:09:34.508806 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.509177 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.523247 26317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:34.524214 26317 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:34.524570 26317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9afb7003a447087f387b3eab9ee86, State: Initialized, Role: FOLLOWER
I20260807 11:09:34.525604 26317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
W20260807 11:09:34.537009 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.537592 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.542342 26317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:09:34.542531 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:34.543406 26281 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda42d40a62841349371a2ca0bd85a37 in term 0.
I20260807 11:09:34.544837 26472 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37; no voters:
I20260807 11:09:34.545780 26544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:34.546072 26544 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:34.546329 26544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:34.541182 26568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:34.547605 26568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:34.552897 26544 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:34.557849 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86"
I20260807 11:09:34.558409 26281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:34.564793 26281 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda42d40a62841349371a2ca0bd85a37 in term 1.
I20260807 11:09:34.565956 26472 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37; no voters:
I20260807 11:09:34.569190 26544 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
I20260807 11:09:34.569715 26544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 11:09:34.568826 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 11:09:34.570182 26544 raft_consensus.cc:686] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 1 LEADER]: Becoming Leader. State: Replica: fda42d40a62841349371a2ca0bd85a37, State: Running, Role: LEADER
W20260807 11:09:34.570271 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.571192 26544 consensus_queue.cc:237] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:34.582628 26570 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda42d40a62841349371a2ca0bd85a37. Latest consensus state: current_term: 1 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:34.583832 26570 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: LEADER
W20260807 11:09:34.584911 26563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 11:09:34.585196 26563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.587391 26575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 11:09:34.599612 26575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 11:09:34.636711 26281 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Refusing update from remote peer fda42d40a62841349371a2ca0bd85a37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 11:09:34.638736 26544 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:34.659245 26568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda42d40a62841349371a2ca0bd85a37. Latest consensus state: current_term: 1 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:34.662010 26583 mvcc.cc:205] Tried to move back new op lower bound from 7315869592072544256 to 7315869591853658112. Current Snapshot: MvccSnapshot[applied={T|T < 7315869592072544256}]
I20260807 11:09:34.660032 26568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:34.678828 26570 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:34.679597 26570 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:34.682286 26575 catalog_manager.cc:1347] Generated new cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:34.682559 26575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 11:09:34.689663 26568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:34.690482 26568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:34.726642 26575 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 11:09:34.727285 26603 catalog_manager.cc:1259] Loaded cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:34.727555 26603 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: loading cluster ID for follower catalog manager: success
I20260807 11:09:34.734704 26575 catalog_manager.cc:1504] Loading token signing keys...
I20260807 11:09:34.746680 26603 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: acquiring CA information for follower catalog manager: success
W20260807 11:09:34.750921 26603 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
W20260807 11:09:34.765887 26603 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.719435 26211 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: OK, instance_id { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" instance_seqno: 1786100972495566 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 11:09:34.768867 26211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:09:34.791254 26603 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
W20260807 11:09:34.808967 26603 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260807 11:09:34.809410 26575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Generated new TSK 0
I20260807 11:09:34.810585 26575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 11:09:34.815173 26575 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260807 11:09:34.827082 26603 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 11:09:34.827625 26575 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260807 11:09:34.865203 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.115.193:0
--local_ip_for_outbound_sockets=127.22.115.193
--webserver_interface=127.22.115.193
--webserver_port=0
--tserver_master_addrs=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260807 11:09:34.869956 26427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } attempt: 7
I20260807 11:09:34.930033 26427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: Bootstrap starting.
I20260807 11:09:34.952131 26427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:34.958298 26427 log.cc:824] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: Log is configured to *not* fsync() on all Append() calls
I20260807 11:09:34.983748 26427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: No bootstrap required, opened a new log
W20260807 11:09:34.988772 26465 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.115.253:45313 timed out after 0.568s (SENT)
I20260807 11:09:35.098495 26427 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:35.101382 26427 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:35.102391 26427 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d274e2557344d4a38dfb83e8438d1a, State: Initialized, Role: FOLLOWER
I20260807 11:09:35.107275 26427 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:35.122112 26611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:35.122979 26611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:35.134130 26386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:35.138402 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:35.140071 26388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
W20260807 11:09:35.141086 26388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42352 (request call id 1) took 721 ms (client timeout 568 ms). Trace:
W20260807 11:09:35.141420 26388 rpcz_store.cc:269] 0807 11:09:34.419830 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:34.420020 (+ 190us) service_pool.cc:227] Handling call
0807 11:09:35.141005 (+720985us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:35.142459 26387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a"
W20260807 11:09:35.143324 26387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42352 (request call id 2) took 573 ms (client timeout 568 ms). Trace:
W20260807 11:09:35.143653 26387 rpcz_store.cc:269] 0807 11:09:34.569950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 11:09:34.570123 (+ 173us) service_pool.cc:227] Handling call
0807 11:09:35.143267 (+573144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 11:09:35.148955 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a"
I20260807 11:09:35.152343 26386 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Refusing update from remote peer fda42d40a62841349371a2ca0bd85a37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 11:09:35.154021 26544 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:35.166013 26427 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:09:35.224399 26611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda42d40a62841349371a2ca0bd85a37. Latest consensus state: current_term: 1 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:35.225181 26611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:35.224598 26618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:35.226037 26618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:35.352634 26646 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 11:09:35.376096 26646 catalog_manager.cc:1259] Loaded cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:35.379321 26646 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: loading cluster ID for follower catalog manager: success
I20260807 11:09:35.396272 26646 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: acquiring CA information for follower catalog manager: success
I20260807 11:09:35.409088 26646 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 11:09:35.442212 26606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:35.442997 26606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:35.444103 26606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:09:35.545596 26606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:35.547199 26606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.115.193
I20260807 11:09:35.609409 26606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.115.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.115.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.115.193
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:35.611132 26606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:35.613369 26606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:09:35.654641 26661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:35.660810 26618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:35.661330 26618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:35.665129 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:35.667466 26618 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:35.667558 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:35.669246 26354 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:35.670116 26611 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:35.797691 26544 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:35.798462 26544 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:36.752817 26672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:36.756620 26672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:36.764330 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:36.765177 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:36.768550 26239 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:36.774674 26672 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:36.775766 26672 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:09:35.687016 26660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:35.662812 26606 server_base.cc:1034] running on GCE node
W20260807 11:09:35.669116 26664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:37.158802 26606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:37.167410 26606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:37.168859 26606 hybrid_clock.cc:648] HybridClock initialized: now 1786100977168824 us; error 49 us; skew 500 ppm
I20260807 11:09:37.169943 26606 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:37.199702 26606 webserver.cc:460] Webserver started at http://127.22.115.193:46491/ using document root <none> and password file <none>
I20260807 11:09:37.201043 26606 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:37.201349 26606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:37.201949 26606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:09:37.210386 26606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data/instance:
uuid: "8309fc2e61b043479ade345c383361cc"
format_stamp: "Formatted at 2026-08-07 11:09:37 on dist-test-slave-5bn2"
I20260807 11:09:37.211912 26606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal/instance:
uuid: "8309fc2e61b043479ade345c383361cc"
format_stamp: "Formatted at 2026-08-07 11:09:37 on dist-test-slave-5bn2"
I20260807 11:09:37.212926 26677 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:37.223161 26677 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:37.225318 26677 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:37.227470 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:37.227742 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:37.229708 26606 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.006s sys 0.008s
I20260807 11:09:37.229403 26354 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:37.230410 26677 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:37.247668 26679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:37.249125 26606 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.007s sys 0.004s
I20260807 11:09:37.249603 26606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal
uuid: "8309fc2e61b043479ade345c383361cc"
format_stamp: "Formatted at 2026-08-07 11:09:37 on dist-test-slave-5bn2"
I20260807 11:09:37.250202 26606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:37.332082 26606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:37.334182 26606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:37.334920 26606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:37.344182 26606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 11:09:37.355963 26606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 11:09:37.356329 26606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 11:09:37.356707 26606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 11:09:37.356992 26606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:37.358999 26684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:37.359640 26684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:37.362883 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:37.370501 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:37.372303 26239 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:37.377828 26684 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:37.379621 26688 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:37.659103 26606 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.193:33907
I20260807 11:09:37.659217 26851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.193:33907 every 8 connection(s)
I20260807 11:09:37.662978 26606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/data/info.pb
I20260807 11:09:37.673065 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 26606
I20260807 11:09:37.673825 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal/instance
I20260807 11:09:37.734228 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.115.194:0
--local_ip_for_outbound_sockets=127.22.115.194
--webserver_interface=127.22.115.194
--webserver_port=0
--tserver_master_addrs=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260807 11:09:37.754544 26866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:37.755059 26866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:37.756965 26866 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:37.757735 26853 heartbeater.cc:347] Connected to a master server at 127.22.115.253:45313
I20260807 11:09:37.757699 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:37.758226 26853 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:37.759445 26853 heartbeater.cc:511] Master 127.22.115.253:45313 requested a full tablet report, sending...
I20260807 11:09:37.761313 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:37.762598 26352 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:37.763553 26866 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:37.765019 26375 ts_manager.cc:194] Registered new tserver with Master: 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907)
I20260807 11:09:37.777745 26860 heartbeater.cc:347] Connected to a master server at 127.22.115.254:33273
I20260807 11:09:37.778101 26860 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:37.778949 26860 heartbeater.cc:511] Master 127.22.115.254:33273 requested a full tablet report, sending...
I20260807 11:09:37.780553 26852 heartbeater.cc:347] Connected to a master server at 127.22.115.252:37249
I20260807 11:09:37.780898 26852 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:37.781673 26852 heartbeater.cc:511] Master 127.22.115.252:37249 requested a full tablet report, sending...
I20260807 11:09:37.782109 26265 ts_manager.cc:194] Registered new tserver with Master: 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907)
I20260807 11:09:37.784058 26490 ts_manager.cc:194] Registered new tserver with Master: 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907)
I20260807 11:09:37.787041 26490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.115.193:36881
I20260807 11:09:37.919476 26868 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:37.919950 26868 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:37.921823 26868 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:37.923533 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:37.924216 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:37.925850 26239 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:37.926667 26868 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:09:38.193903 26867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:38.194435 26867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:38.195057 26867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:09:38.229645 26867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:38.231092 26867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.115.194
I20260807 11:09:38.266561 26867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.115.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.115.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.115.194
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:38.267890 26867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:38.269933 26867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 11:09:38.278518 26874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:38.279222 26874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:38.281618 26874 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:38.282579 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:38.282702 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:38.284166 26354 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:38.285084 26874 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:38.291679 26852 heartbeater.cc:503] Master 127.22.115.252:37249 was elected leader, sending a full tablet report...
W20260807 11:09:38.295608 26879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:38.848668 26888 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:38.849247 26888 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:38.852049 26888 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:38.853971 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:38.854297 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:38.856025 26237 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:38.858911 26888 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:09:38.297981 26876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:38.298765 26867 server_base.cc:1034] running on GCE node
W20260807 11:09:38.299173 26884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:39.416560 26867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:39.418928 26867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:39.420301 26867 hybrid_clock.cc:648] HybridClock initialized: now 1786100979420253 us; error 35 us; skew 500 ppm
I20260807 11:09:39.421126 26867 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:39.427266 26867 webserver.cc:460] Webserver started at http://127.22.115.194:45389/ using document root <none> and password file <none>
I20260807 11:09:39.428153 26867 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:39.428336 26867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:39.428736 26867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:09:39.433866 26867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data/instance:
uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
format_stamp: "Formatted at 2026-08-07 11:09:39 on dist-test-slave-5bn2"
I20260807 11:09:39.434991 26867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal/instance:
uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
format_stamp: "Formatted at 2026-08-07 11:09:39 on dist-test-slave-5bn2"
I20260807 11:09:39.442219 26867 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260807 11:09:39.447788 26896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:39.448835 26867 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260807 11:09:39.449148 26867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal
uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
format_stamp: "Formatted at 2026-08-07 11:09:39 on dist-test-slave-5bn2"
I20260807 11:09:39.449488 26867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:39.483457 26867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:39.484975 26867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:39.485509 26867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:39.491575 26867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 11:09:39.498099 26867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 11:09:39.498374 26867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:39.498690 26867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 11:09:39.498909 26867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260807 11:09:39.665259 26867 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.194:41309
I20260807 11:09:39.665324 27061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.194:41309 every 8 connection(s)
I20260807 11:09:39.669430 26867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/data/info.pb
I20260807 11:09:39.677865 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 26867
I20260807 11:09:39.678424 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal/instance
I20260807 11:09:39.700353 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.115.195:0
--local_ip_for_outbound_sockets=127.22.115.195
--webserver_interface=127.22.115.195
--webserver_port=0
--tserver_master_addrs=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260807 11:09:39.727329 27065 heartbeater.cc:347] Connected to a master server at 127.22.115.253:45313
I20260807 11:09:39.727861 27065 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:39.728528 27063 heartbeater.cc:347] Connected to a master server at 127.22.115.252:37249
I20260807 11:09:39.728883 27063 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:39.729182 27065 heartbeater.cc:511] Master 127.22.115.253:45313 requested a full tablet report, sending...
I20260807 11:09:39.729887 27063 heartbeater.cc:511] Master 127.22.115.252:37249 requested a full tablet report, sending...
I20260807 11:09:39.732192 26490 ts_manager.cc:194] Registered new tserver with Master: e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
I20260807 11:09:39.732868 26375 ts_manager.cc:194] Registered new tserver with Master: e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
I20260807 11:09:39.733919 26490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.115.194:57177
I20260807 11:09:39.747188 27068 heartbeater.cc:347] Connected to a master server at 127.22.115.254:33273
I20260807 11:09:39.747577 27068 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:39.748325 27068 heartbeater.cc:511] Master 127.22.115.254:33273 requested a full tablet report, sending...
I20260807 11:09:39.751070 26265 ts_manager.cc:194] Registered new tserver with Master: e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:09:40.047070 27076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:40.047561 27076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:40.048127 27076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:09:40.079486 27076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:40.080470 27076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.115.195
I20260807 11:09:40.115267 27076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.115.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.115.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.115.195
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:40.116523 27076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:40.118052 27076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:09:40.136423 27090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:40.238320 27063 heartbeater.cc:503] Master 127.22.115.252:37249 was elected leader, sending a full tablet report...
I20260807 11:09:40.283674 27094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:40.284119 27094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:40.286571 27094 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:40.286449 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:40.287745 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:40.289359 26239 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:40.289951 27094 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:41.149267 27095 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:41.149675 27095 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:41.151273 27095 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:41.152189 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:41.152376 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:41.153756 26354 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:41.154490 27095 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 11:09:40.136468 27088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:40.138545 27076 server_base.cc:1034] running on GCE node
W20260807 11:09:40.136597 27086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:41.251916 27076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:41.254801 27076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:41.256245 27076 hybrid_clock.cc:648] HybridClock initialized: now 1786100981256204 us; error 49 us; skew 500 ppm
I20260807 11:09:41.257025 27076 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:41.267100 27076 webserver.cc:460] Webserver started at http://127.22.115.195:43023/ using document root <none> and password file <none>
I20260807 11:09:41.268325 27076 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:41.268569 27076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:41.269151 27076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 11:09:41.274236 27076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data/instance:
uuid: "2db2a74f0f644f409db457a35ecf95e8"
format_stamp: "Formatted at 2026-08-07 11:09:41 on dist-test-slave-5bn2"
I20260807 11:09:41.275524 27076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal/instance:
uuid: "2db2a74f0f644f409db457a35ecf95e8"
format_stamp: "Formatted at 2026-08-07 11:09:41 on dist-test-slave-5bn2"
I20260807 11:09:41.282768 27076 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260807 11:09:41.285557 27101 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:41.286001 27101 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:41.288631 27101 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:41.290506 27102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:41.288749 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:41.290387 26503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:41.291994 27076 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.001s
I20260807 11:09:41.292362 27076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal
uuid: "2db2a74f0f644f409db457a35ecf95e8"
format_stamp: "Formatted at 2026-08-07 11:09:41 on dist-test-slave-5bn2"
I20260807 11:09:41.292775 27076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:41.293002 26237 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:41.293615 27101 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:41.337612 27076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:41.339282 27076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:41.339752 27076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:41.342303 27076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 11:09:41.346949 27076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 11:09:41.347136 27076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:41.347344 27076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 11:09:41.347471 27076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:41.486034 27076 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.195:33411
I20260807 11:09:41.486145 27257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.195:33411 every 8 connection(s)
I20260807 11:09:41.488511 27076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/data/info.pb
I20260807 11:09:41.498342 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 27076
I20260807 11:09:41.498893 22991 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal/instance
I20260807 11:09:41.540052 27258 heartbeater.cc:347] Connected to a master server at 127.22.115.252:37249
I20260807 11:09:41.540545 27258 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:41.541774 27258 heartbeater.cc:511] Master 127.22.115.252:37249 requested a full tablet report, sending...
I20260807 11:09:41.544502 26490 ts_manager.cc:194] Registered new tserver with Master: 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:41.546494 26490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.115.195:50373
I20260807 11:09:41.548269 27259 heartbeater.cc:347] Connected to a master server at 127.22.115.253:45313
I20260807 11:09:41.548600 27259 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:41.549466 27259 heartbeater.cc:511] Master 127.22.115.253:45313 requested a full tablet report, sending...
I20260807 11:09:41.552271 26375 ts_manager.cc:194] Registered new tserver with Master: 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:41.554453 27262 heartbeater.cc:347] Connected to a master server at 127.22.115.254:33273
I20260807 11:09:41.554754 27262 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:41.555395 27262 heartbeater.cc:511] Master 127.22.115.254:33273 requested a full tablet report, sending...
I20260807 11:09:41.557377 26265 ts_manager.cc:194] Registered new tserver with Master: 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:41.571470 22991 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 11:09:41.614045 26490 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36370:
name: "default.Table_7c2b24407f7e4d128d948b0dde1601f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:41.614614 26487 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36370:
name: "default.Table_cc398fbd66d84034990dd646a25d8ccd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:41.615783 26488 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36370:
name: "default.Table_cef4ae08a7e64e10aa23c07621f7983b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:41.618018 26486 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36370:
name: "default.Table_2dcda62b2c384802b0be6b568b499c9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:09:41.624387 26490 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7c2b24407f7e4d128d948b0dde1601f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:09:41.636920 26487 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cc398fbd66d84034990dd646a25d8ccd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:09:41.636976 26488 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cef4ae08a7e64e10aa23c07621f7983b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:09:41.638866 26486 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2dcda62b2c384802b0be6b568b499c9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:09:41.656929 22991 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu with pid 26428
W20260807 11:09:41.718762 27273 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.115.252:37249)
W20260807 11:09:41.759163 27063 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:41.771821 27302 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:41.772527 27302 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:41.776731 26281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:41.776947 27302 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:41.780067 26352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260807 11:09:41.784734 26352 leader_election.cc:334] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:41.785148 26352 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:41.785900 27302 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 11:09:41.798418 27306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:41.798843 27306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:41.801391 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a" is_pre_election: true
I20260807 11:09:41.801955 26385 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9afb7003a447087f387b3eab9ee86 in term 1.
I20260807 11:09:41.803753 26237 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86, 79d274e2557344d4a38dfb83e8438d1a; no voters:
I20260807 11:09:41.807533 27306 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:41.808956 27306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 11:09:41.809226 27306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:41.809533 27306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 1 FOLLOWER]: Advancing to term 2
W20260807 11:09:41.823551 26239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111) [suppressed 12 similar messages]
W20260807 11:09:41.825529 26852 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:09:41.828682 26239 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:41.828341 27306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:41.830410 27306 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 election: Requested vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:41.833271 26385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ef9afb7003a447087f387b3eab9ee86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79d274e2557344d4a38dfb83e8438d1a"
I20260807 11:09:41.833810 26385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 1 FOLLOWER]: Advancing to term 2
W20260807 11:09:41.835223 26239 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:41.841714 26385 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9afb7003a447087f387b3eab9ee86 in term 2.
I20260807 11:09:41.842748 26237 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86, 79d274e2557344d4a38dfb83e8438d1a; no voters: fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:41.843786 27306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 11:09:41.844496 27306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 2 LEADER]: Becoming Leader. State: Replica: 6ef9afb7003a447087f387b3eab9ee86, State: Running, Role: LEADER
I20260807 11:09:41.845461 27306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:41.876761 27310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ef9afb7003a447087f387b3eab9ee86. Latest consensus state: current_term: 2 leader_uuid: "6ef9afb7003a447087f387b3eab9ee86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:41.877578 27310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:41.909061 27319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 11:09:41.917749 27319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 11:09:41.934059 27319 catalog_manager.cc:1259] Loaded cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:41.934456 27319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 11:09:41.940306 27319 catalog_manager.cc:1504] Loading token signing keys...
I20260807 11:09:41.944042 27319 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Loaded TSK: 0
I20260807 11:09:41.945587 27319 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 11:09:41.951393 27319 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260807 11:09:41.955017 27319 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260807 11:09:41.973680 26264 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_cc398fbd66d84034990dd646a25d8ccd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:41.975301 26262 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_7c2b24407f7e4d128d948b0dde1601f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:41.976068 26263 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_cef4ae08a7e64e10aa23c07621f7983b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:41.970762 26265 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_2dcda62b2c384802b0be6b568b499c9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 11:09:41.987576 26264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cc398fbd66d84034990dd646a25d8ccd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:09:41.988556 26262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7c2b24407f7e4d128d948b0dde1601f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:09:41.992247 26265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2dcda62b2c384802b0be6b568b499c9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 11:09:41.992272 26263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cef4ae08a7e64e10aa23c07621f7983b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 11:09:42.054517 27258 heartbeater.cc:503] Master 127.22.115.252:37249 was elected leader, sending a full tablet report...
W20260807 11:09:42.072685 27258 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:42.209184 26263 catalog_manager.cc:2148] created HMS catalog entry for table [id=15a54eb515534d41a3a0f03753640785]
I20260807 11:09:42.221746 26385 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Refusing update from remote peer 6ef9afb7003a447087f387b3eab9ee86: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 11:09:42.223503 27310 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 11:09:42.229207 26239 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 -> Peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Couldn't send request to peer fda42d40a62841349371a2ca0bd85a37. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:42.232301 27302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ef9afb7003a447087f387b3eab9ee86. Latest consensus state: current_term: 2 leader_uuid: "6ef9afb7003a447087f387b3eab9ee86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:42.233144 27302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:42.241691 27323 mvcc.cc:205] Tried to move back new op lower bound from 7315869623162032128 to 7315869621648891904. Current Snapshot: MvccSnapshot[applied={T|T < 7315869623162032128}]
I20260807 11:09:42.248620 26264 catalog_manager.cc:2148] created HMS catalog entry for table [id=177e77e7b54247ae8404f11de2cd6ec2]
I20260807 11:09:42.259137 27310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "6ef9afb7003a447087f387b3eab9ee86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:42.259857 27310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:42.262269 26263 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33026:
table { table_name: "default.Table_cef4ae08a7e64e10aa23c07621f7983b" } new_table_name: "default.Table_cc7b52ebb5b8493d8a72b9e9073d6cfa" modify_external_catalogs: true
I20260807 11:09:42.262425 27302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "6ef9afb7003a447087f387b3eab9ee86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:42.263126 27302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:42.298122 26264 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33026:
table { table_name: "default.Table_cc398fbd66d84034990dd646a25d8ccd" } new_table_name: "default.Table_3162e0d20d2d4ea5be08d1b23d21ffcb" modify_external_catalogs: true
I20260807 11:09:42.300748 26265 catalog_manager.cc:2148] created HMS catalog entry for table [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]
I20260807 11:09:42.337260 26265 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33026:
table { table_name: "default.Table_2dcda62b2c384802b0be6b568b499c9e" } modify_external_catalogs: true
I20260807 11:09:42.338109 26265 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33026:
table { table_name: "default.Table_2dcda62b2c384802b0be6b568b499c9e" } modify_external_catalogs: true
I20260807 11:09:42.403039 27170 tablet_service.cc:1467] Processing CreateTablet for tablet 4493bdc609d64b5faec420679a9bef08 (DEFAULT_TABLE table=default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.403028 27172 tablet_service.cc:1467] Processing CreateTablet for tablet 237991fbd81a47a58865556f63bce2cf (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.407109 27172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 237991fbd81a47a58865556f63bce2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.412886 27170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4493bdc609d64b5faec420679a9bef08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.418334 26757 tablet_service.cc:1467] Processing CreateTablet for tablet 237991fbd81a47a58865556f63bce2cf (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.420217 26757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 237991fbd81a47a58865556f63bce2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.425591 26756 tablet_service.cc:1467] Processing CreateTablet for tablet 4493bdc609d64b5faec420679a9bef08 (DEFAULT_TABLE table=default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.426734 26756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4493bdc609d64b5faec420679a9bef08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.426610 27167 tablet_service.cc:1467] Processing CreateTablet for tablet 65810618a1924caba9ee34759e8d23c8 (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.427731 27167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65810618a1924caba9ee34759e8d23c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.429287 26754 tablet_service.cc:1467] Processing CreateTablet for tablet 65810618a1924caba9ee34759e8d23c8 (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.430452 26754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65810618a1924caba9ee34759e8d23c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.461462 26968 tablet_service.cc:1467] Processing CreateTablet for tablet 237991fbd81a47a58865556f63bce2cf (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.462302 26261 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_5f08f5483b4e4b69af546b339cc1f064"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:42.463789 26967 tablet_service.cc:1467] Processing CreateTablet for tablet 4493bdc609d64b5faec420679a9bef08 (DEFAULT_TABLE table=default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.465018 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4493bdc609d64b5faec420679a9bef08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.469014 26966 tablet_service.cc:1467] Processing CreateTablet for tablet 65810618a1924caba9ee34759e8d23c8 (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.470180 26966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65810618a1924caba9ee34759e8d23c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.475384 26968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 237991fbd81a47a58865556f63bce2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.486765 26260 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_9d2e3b5c1bee4b7aa5ed25dbeec04f42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:42.488348 27344 tablet_bootstrap.cc:492] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
I20260807 11:09:42.499408 27344 tablet_bootstrap.cc:654] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:42.501693 27344 log.cc:824] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Log is configured to *not* fsync() on all Append() calls
I20260807 11:09:42.513259 26259 master_service.cc:946] ReplaceTablet: received request to replace tablet 237991fbd81a47a58865556f63bce2cf from {username='slave'} at 127.0.0.1:33026
I20260807 11:09:42.523711 26256 master_service.cc:946] ReplaceTablet: received request to replace tablet 237991fbd81a47a58865556f63bce2cf from {username='slave'} at 127.0.0.1:33026
I20260807 11:09:42.537623 27345 tablet_bootstrap.cc:492] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
I20260807 11:09:42.538241 26255 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_937417113ef94762a2763376d99a2f2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:42.547961 26259 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Sending DeleteTablet for 3 replicas of tablet 237991fbd81a47a58865556f63bce2cf
I20260807 11:09:42.551165 27167 tablet_service.cc:1514] Processing DeleteTablet for tablet 237991fbd81a47a58865556f63bce2cf with delete_type TABLET_DATA_DELETED (replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7) from {username='slave'} at 127.0.0.1:49024
I20260807 11:09:42.558241 26756 tablet_service.cc:1514] Processing DeleteTablet for tablet 237991fbd81a47a58865556f63bce2cf with delete_type TABLET_DATA_DELETED (replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7) from {username='slave'} at 127.0.0.1:43238
I20260807 11:09:42.559285 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 237991fbd81a47a58865556f63bce2cf with delete_type TABLET_DATA_DELETED (replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7) from {username='slave'} at 127.0.0.1:41028
I20260807 11:09:42.562469 27262 heartbeater.cc:503] Master 127.22.115.254:33273 was elected leader, sending a full tablet report...
I20260807 11:09:42.567662 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:37249
--webserver_interface=127.22.115.252
--webserver_port=38673
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--hive_metastore_uris=thrift://127.0.0.1:45587
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260807 11:09:42.570225 26239 catalog_manager.cc:4821] TS 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411): delete failed for tablet 237991fbd81a47a58865556f63bce2cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 237991fbd81a47a58865556f63bce2cf already in progress: creating tablet
11:09:42.572 [HMS - ERROR - pool-6-thread-2] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_7c2b24407f7e4d128d948b0dde1601f7 already exists)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at com.sun.proxy.$Proxy25.create_table_with_environment_context(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
W20260807 11:09:42.573179 26243 catalog_manager.cc:4808] TS e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): delete failed for tablet 237991fbd81a47a58865556f63bce2cf because the tablet was not found. No further retry: Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:09:42.576680 26262 catalog_manager.cc:2144] Already present: failed to create HMS catalog entry for table [id=ec514f6184d84e5f99f6bdd719ddc35f]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_7c2b24407f7e4d128d948b0dde1601f7 already exists)
I20260807 11:09:42.594255 27345 tablet_bootstrap.cc:654] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:42.594812 26754 tablet_service.cc:1467] Processing CreateTablet for tablet 6a0e9b9e5f14459382c6497146e7a0c7 (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.595955 26754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a0e9b9e5f14459382c6497146e7a0c7. 1 dirs total, 0 dirs full, 0 dirs failed
F20260807 11:09:42.595969 26600 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_7c2b24407f7e4d128d948b0dde1601f7
I20260807 11:09:42.596817 27345 log.cc:824] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Log is configured to *not* fsync() on all Append() calls
*** Check failure stack trace: ***
I20260807 11:09:42.600225 27344 tablet_bootstrap.cc:492] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:42.600754 27344 ts_tablet_manager.cc:1397] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.113s user 0.024s sys 0.015s
I20260807 11:09:42.601326 26965 tablet_service.cc:1467] Processing CreateTablet for tablet 6a0e9b9e5f14459382c6497146e7a0c7 (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.602784 27167 tablet_service.cc:1467] Processing CreateTablet for tablet 6a0e9b9e5f14459382c6497146e7a0c7 (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.603603 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a0e9b9e5f14459382c6497146e7a0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.603904 27167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a0e9b9e5f14459382c6497146e7a0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.614411 26262 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "default.Table_54143a9db286438995e80f4662d9c52b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:42.616791 27355 tablet_bootstrap.cc:492] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
I20260807 11:09:42.618508 26259 catalog_manager.cc:6565] ReplaceTablet: tablet 237991fbd81a47a58865556f63bce2cf deleted and replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7
I20260807 11:09:42.621783 27170 tablet_service.cc:1514] Processing DeleteTablet for tablet 237991fbd81a47a58865556f63bce2cf with delete_type TABLET_DATA_DELETED (replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7) from {username='slave'} at 127.0.0.1:49024
W20260807 11:09:42.623355 26239 catalog_manager.cc:4821] TS 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411): delete failed for tablet 237991fbd81a47a58865556f63bce2cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 237991fbd81a47a58865556f63bce2cf already in progress: creating tablet
W20260807 11:09:42.653059 26243 catalog_manager.cc:4821] TS 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): delete failed for tablet 237991fbd81a47a58865556f63bce2cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 237991fbd81a47a58865556f63bce2cf already in progress: creating tablet
@ 0x7f9319d3f9a0 google::LogMessage::Flush() at ??:0
I20260807 11:09:42.656968 27345 tablet_bootstrap.cc:492] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:42.657505 27345 ts_tablet_manager.cc:1397] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.121s user 0.017s sys 0.011s
I20260807 11:09:42.680572 27355 tablet_bootstrap.cc:654] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
@ 0x7f9319d3f70f google::LogMessage::~LogMessage() at ??:0
I20260807 11:09:42.696939 27355 log.cc:824] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Log is configured to *not* fsync() on all Append() calls
I20260807 11:09:42.714944 27355 tablet_bootstrap.cc:492] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:42.715484 27355 ts_tablet_manager.cc:1397] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.099s user 0.015s sys 0.000s
I20260807 11:09:42.719094 27345 raft_consensus.cc:348] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.719964 27345 raft_consensus.cc:374] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.719496 27344 raft_consensus.cc:348] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:42.720230 27345 raft_consensus.cc:729] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.720366 27344 raft_consensus.cc:374] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.720638 27344 raft_consensus.cc:729] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.721277 27345 consensus_queue.cc:260] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.721514 27344 consensus_queue.cc:260] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
@ 0x7f9324ddaaea kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260807 11:09:42.738076 27345 ts_tablet_manager.cc:1428] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.080s user 0.038s sys 0.003s
I20260807 11:09:42.757310 26256 master_service.cc:946] ReplaceTablet: received request to replace tablet 4493bdc609d64b5faec420679a9bef08 from {username='slave'} at 127.0.0.1:33026
@ 0x7f9324dda33c kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260807 11:09:42.759143 26860 heartbeater.cc:503] Master 127.22.115.254:33273 was elected leader, sending a full tablet report...
I20260807 11:09:42.761545 27344 ts_tablet_manager.cc:1428] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.161s user 0.026s sys 0.020s
I20260807 11:09:42.762428 27344 tablet_bootstrap.cc:492] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
W20260807 11:09:42.774550 27267 tablet.cc:2369] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 11:09:42.777385 27344 tablet_bootstrap.cc:654] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:42.783624 27068 heartbeater.cc:503] Master 127.22.115.254:33273 was elected leader, sending a full tablet report...
I20260807 11:09:42.794842 27344 tablet_bootstrap.cc:492] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:42.795360 27344 ts_tablet_manager.cc:1397] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.000s
I20260807 11:09:42.797642 26756 tablet_service.cc:1514] Processing DeleteTablet for tablet 237991fbd81a47a58865556f63bce2cf with delete_type TABLET_DATA_DELETED (replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7) from {username='slave'} at 127.0.0.1:43238
I20260807 11:09:42.798550 27353 tablet_replica.cc:330] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: stopping tablet replica
I20260807 11:09:42.798259 27344 raft_consensus.cc:348] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
@ 0x7f9324dddfd2 kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260807 11:09:42.799108 27344 raft_consensus.cc:374] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.799374 27353 raft_consensus.cc:2229] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:42.799911 27353 raft_consensus.cc:2258] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:42.803223 27353 ts_tablet_manager.cc:1905] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:42.799391 27344 raft_consensus.cc:729] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.804567 27344 consensus_queue.cc:260] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.805716 26756 tablet_service.cc:1514] Processing DeleteTablet for tablet 4493bdc609d64b5faec420679a9bef08 with delete_type TABLET_DATA_DELETED (replaced by tablet 4425d9ee4e1c4d3385a8e9a516c50ff2) from {username='slave'} at 127.0.0.1:43238
I20260807 11:09:42.806901 27344 ts_tablet_manager.cc:1428] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 11:09:42.807739 27344 tablet_bootstrap.cc:492] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
I20260807 11:09:42.810101 26256 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Sending DeleteTablet for 3 replicas of tablet 4493bdc609d64b5faec420679a9bef08
I20260807 11:09:42.756973 27345 tablet_bootstrap.cc:492] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
I20260807 11:09:42.812664 26756 tablet_service.cc:1514] Processing DeleteTablet for tablet 4493bdc609d64b5faec420679a9bef08 with delete_type TABLET_DATA_DELETED (replaced by tablet 4425d9ee4e1c4d3385a8e9a516c50ff2) from {username='slave'} at 127.0.0.1:43238
I20260807 11:09:42.814085 27344 tablet_bootstrap.cc:654] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:42.826620 27167 tablet_service.cc:1514] Processing DeleteTablet for tablet 4493bdc609d64b5faec420679a9bef08 with delete_type TABLET_DATA_DELETED (replaced by tablet 4425d9ee4e1c4d3385a8e9a516c50ff2) from {username='slave'} at 127.0.0.1:49024
I20260807 11:09:42.827322 26256 catalog_manager.cc:6565] ReplaceTablet: tablet 4493bdc609d64b5faec420679a9bef08 deleted and replaced by tablet 4425d9ee4e1c4d3385a8e9a516c50ff2
W20260807 11:09:42.828344 26239 catalog_manager.cc:4821] TS 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411): delete failed for tablet 4493bdc609d64b5faec420679a9bef08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4493bdc609d64b5faec420679a9bef08 already in progress: creating tablet
@ 0x7f9324dddf8a _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
I20260807 11:09:42.831211 27344 tablet_bootstrap.cc:492] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:42.831653 27344 ts_tablet_manager.cc:1397] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.011s
I20260807 11:09:42.834102 27344 raft_consensus.cc:348] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.834796 27344 raft_consensus.cc:374] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.835137 27344 raft_consensus.cc:729] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.839118 26256 master_service.cc:946] ReplaceTablet: received request to replace tablet 6a0e9b9e5f14459382c6497146e7a0c7 from {username='slave'} at 127.0.0.1:33026
I20260807 11:09:42.835796 27344 consensus_queue.cc:260] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.844364 27344 ts_tablet_manager.cc:1428] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260807 11:09:42.845350 27344 tablet_bootstrap.cc:492] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
@ 0x7f9324dddf1a std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260807 11:09:42.851831 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 237991fbd81a47a58865556f63bce2cf with delete_type TABLET_DATA_DELETED (replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7) from {username='slave'} at 127.0.0.1:41028
I20260807 11:09:42.852228 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet 4493bdc609d64b5faec420679a9bef08 with delete_type TABLET_DATA_DELETED (replaced by tablet 4425d9ee4e1c4d3385a8e9a516c50ff2) from {username='slave'} at 127.0.0.1:41028
I20260807 11:09:42.852583 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 4493bdc609d64b5faec420679a9bef08 with delete_type TABLET_DATA_DELETED (replaced by tablet 4425d9ee4e1c4d3385a8e9a516c50ff2) from {username='slave'} at 127.0.0.1:41028
W20260807 11:09:42.854781 26243 catalog_manager.cc:4821] TS e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): delete failed for tablet 237991fbd81a47a58865556f63bce2cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 237991fbd81a47a58865556f63bce2cf already in progress: creating tablet
W20260807 11:09:42.855809 26243 catalog_manager.cc:4821] TS e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): delete failed for tablet 4493bdc609d64b5faec420679a9bef08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4493bdc609d64b5faec420679a9bef08 already in progress: creating tablet
W20260807 11:09:42.856968 26243 catalog_manager.cc:4821] TS e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): delete failed for tablet 4493bdc609d64b5faec420679a9bef08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4493bdc609d64b5faec420679a9bef08 already in progress: creating tablet
I20260807 11:09:42.861726 27344 tablet_bootstrap.cc:654] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
@ 0x7f9324dddee2 std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260807 11:09:42.874084 27344 tablet_bootstrap.cc:492] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:42.874579 27344 ts_tablet_manager.cc:1397] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.006s
I20260807 11:09:42.877521 27344 raft_consensus.cc:348] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.878218 27344 raft_consensus.cc:374] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.878496 27344 raft_consensus.cc:729] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.879256 27344 consensus_queue.cc:260] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.883205 27344 ts_tablet_manager.cc:1428] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260807 11:09:42.884286 27353 ts_tablet_manager.cc:1918] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:09:42.884697 27353 log.cc:1196] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/237991fbd81a47a58865556f63bce2cf
I20260807 11:09:42.885628 27353 ts_tablet_manager.cc:1939] T 237991fbd81a47a58865556f63bce2cf P 8309fc2e61b043479ade345c383361cc: Deleting consensus metadata
I20260807 11:09:42.886924 27355 raft_consensus.cc:348] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:42.888019 27355 raft_consensus.cc:374] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.888320 27355 raft_consensus.cc:729] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.889245 27355 consensus_queue.cc:260] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:42.891501 26965 tablet_service.cc:1467] Processing CreateTablet for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2 (DEFAULT_TABLE table=default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.892627 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.892885 27167 tablet_service.cc:1467] Processing CreateTablet for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2 (DEFAULT_TABLE table=default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.893616 27353 tablet_replica.cc:330] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: stopping tablet replica
I20260807 11:09:42.893941 27167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.894343 27353 raft_consensus.cc:2229] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:42.894789 27353 raft_consensus.cc:2258] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:42.896034 26243 catalog_manager.cc:4841] TS 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): tablet 237991fbd81a47a58865556f63bce2cf (table default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]) successfully deleted
I20260807 11:09:42.896926 27353 ts_tablet_manager.cc:1905] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f9324ddd1de std::__1::__function::__func<>::operator()() at ??:0
@ 0x580785 std::__1::__function::__value_func<>::operator()() at ??:?
@ 0x5805ba std::__1::function<>::operator()() at ??:?
I20260807 11:09:42.916775 26756 tablet_service.cc:1467] Processing CreateTablet for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2 (DEFAULT_TABLE table=default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:42.917874 26756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:42.923106 27355 ts_tablet_manager.cc:1428] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.207s user 0.039s sys 0.008s
@ 0x7f931bef0dc7 kudu::Thread::SuperviseThread() at ??:0
I20260807 11:09:42.924052 27355 tablet_bootstrap.cc:492] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
@ 0x4230f0 __tsan_thread_start_func at ??:?
I20260807 11:09:42.929527 27353 ts_tablet_manager.cc:1918] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:09:42.929914 27353 log.cc:1196] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/4493bdc609d64b5faec420679a9bef08
I20260807 11:09:42.932368 27355 tablet_bootstrap.cc:654] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:42.934635 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 237991fbd81a47a58865556f63bce2cf with delete_type TABLET_DATA_DELETED (replaced by tablet 6a0e9b9e5f14459382c6497146e7a0c7) from {username='slave'} at 127.0.0.1:41028
I20260807 11:09:42.935370 27353 ts_tablet_manager.cc:1939] T 4493bdc609d64b5faec420679a9bef08 P 8309fc2e61b043479ade345c383361cc: Deleting consensus metadata
I20260807 11:09:42.935504 27349 tablet_replica.cc:330] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: stopping tablet replica
I20260807 11:09:42.936221 27349 raft_consensus.cc:2229] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:42.936733 27349 raft_consensus.cc:2258] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:42.938035 26243 catalog_manager.cc:4841] TS 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): tablet 4493bdc609d64b5faec420679a9bef08 (table default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]) successfully deleted
W20260807 11:09:42.939693 26243 catalog_manager.cc:4808] TS 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): delete failed for tablet 4493bdc609d64b5faec420679a9bef08 because the tablet was not found. No further retry: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08
@ 0x7f931d55e6db start_thread at ??:0
I20260807 11:09:42.941882 27345 tablet_bootstrap.cc:654] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:42.944798 27349 ts_tablet_manager.cc:1905] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:42.946161 27355 tablet_bootstrap.cc:492] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:42.946553 27355 ts_tablet_manager.cc:1397] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.012s
I20260807 11:09:42.949405 27355 raft_consensus.cc:348] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.950129 27355 raft_consensus.cc:374] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.950402 27355 raft_consensus.cc:729] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.951206 27355 consensus_queue.cc:260] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.953166 27355 ts_tablet_manager.cc:1428] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 11:09:42.953976 27355 tablet_bootstrap.cc:492] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
I20260807 11:09:42.960397 27355 tablet_bootstrap.cc:654] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
@ 0x7f93189e461f clone at ??:0
I20260807 11:09:42.966189 27344 tablet_bootstrap.cc:492] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
I20260807 11:09:42.967427 27345 tablet_bootstrap.cc:492] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:42.967798 27345 ts_tablet_manager.cc:1397] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.211s user 0.011s sys 0.000s
I20260807 11:09:42.970577 27345 raft_consensus.cc:348] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.971269 27345 raft_consensus.cc:374] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.971524 27345 raft_consensus.cc:729] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.972146 27345 consensus_queue.cc:260] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:42.972870 27344 tablet_bootstrap.cc:654] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
W20260807 11:09:42.973649 27077 tablet.cc:2369] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 11:09:42.979171 26864 tablet.cc:2369] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 11:09:42.980568 27345 ts_tablet_manager.cc:1428] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260807 11:09:42.981448 27345 tablet_bootstrap.cc:492] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
I20260807 11:09:42.989445 27349 ts_tablet_manager.cc:1918] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260807 11:09:42.989384 27344 tablet_bootstrap.cc:492] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:42.989874 27349 log.cc:1196] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/237991fbd81a47a58865556f63bce2cf
I20260807 11:09:42.989986 27344 ts_tablet_manager.cc:1397] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.011s
I20260807 11:09:42.990757 27349 ts_tablet_manager.cc:1939] T 237991fbd81a47a58865556f63bce2cf P e13176e9c2f34e6087bc6b57aac0ade3: Deleting consensus metadata
I20260807 11:09:42.992631 27344 raft_consensus.cc:348] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:42.993355 27344 raft_consensus.cc:374] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:42.993644 27344 raft_consensus.cc:729] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
I20260807 11:09:42.994298 27344 consensus_queue.cc:260] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:42.997164 27355 tablet_bootstrap.cc:492] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:42.997577 27355 ts_tablet_manager.cc:1397] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.044s user 0.016s sys 0.001s
I20260807 11:09:43.000771 27355 raft_consensus.cc:348] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.001466 27355 raft_consensus.cc:374] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:43.001722 27355 raft_consensus.cc:729] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:43.002466 27355 consensus_queue.cc:260] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.004702 27355 ts_tablet_manager.cc:1428] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260807 11:09:43.004768 27345 tablet_bootstrap.cc:654] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:43.005596 27355 tablet_bootstrap.cc:492] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
I20260807 11:09:43.011473 27355 tablet_bootstrap.cc:654] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:43.015878 27345 tablet_bootstrap.cc:492] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:43.016247 27345 ts_tablet_manager.cc:1397] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.003s
I20260807 11:09:43.019228 27344 ts_tablet_manager.cc:1428] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.029s user 0.005s sys 0.002s
I20260807 11:09:43.020483 27345 raft_consensus.cc:348] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:43.021143 27345 raft_consensus.cc:374] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:43.021400 27345 raft_consensus.cc:729] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:43.022013 27345 consensus_queue.cc:260] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:43.027468 27345 ts_tablet_manager.cc:1428] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.011s user 0.002s sys 0.004s
I20260807 11:09:43.032678 27345 tablet_bootstrap.cc:492] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
I20260807 11:09:43.038223 27345 tablet_bootstrap.cc:654] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:43.063597 27355 tablet_bootstrap.cc:492] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:43.063975 27355 ts_tablet_manager.cc:1397] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.059s user 0.034s sys 0.016s
I20260807 11:09:43.066000 27355 raft_consensus.cc:348] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.066524 27355 raft_consensus.cc:374] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:43.066833 27355 raft_consensus.cc:729] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:43.067497 27355 consensus_queue.cc:260] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.070003 27355 ts_tablet_manager.cc:1428] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 11:09:43.071003 27355 tablet_bootstrap.cc:492] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
I20260807 11:09:43.076736 27355 tablet_bootstrap.cc:654] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:43.080035 27345 tablet_bootstrap.cc:492] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:43.080550 27345 ts_tablet_manager.cc:1397] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.019s
I20260807 11:09:43.083590 27345 raft_consensus.cc:348] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.084307 27345 raft_consensus.cc:374] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:43.084508 27345 raft_consensus.cc:729] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:43.085013 27345 consensus_queue.cc:260] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.086902 27345 ts_tablet_manager.cc:1428] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 11:09:43.087769 27345 tablet_bootstrap.cc:492] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
I20260807 11:09:43.095005 27355 tablet_bootstrap.cc:492] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:43.095427 27355 ts_tablet_manager.cc:1397] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.000s
I20260807 11:09:43.097946 27355 raft_consensus.cc:348] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.098685 27355 raft_consensus.cc:374] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:43.098999 27355 raft_consensus.cc:729] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:43.099737 27355 consensus_queue.cc:260] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.102437 27345 tablet_bootstrap.cc:654] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:43.106923 27355 ts_tablet_manager.cc:1428] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.011s user 0.003s sys 0.004s
I20260807 11:09:43.133843 27345 tablet_bootstrap.cc:492] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:43.134231 27345 ts_tablet_manager.cc:1397] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.047s user 0.013s sys 0.020s
I20260807 11:09:43.136467 27345 raft_consensus.cc:348] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.137236 27345 raft_consensus.cc:374] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:43.137501 27345 raft_consensus.cc:729] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:43.138171 27345 consensus_queue.cc:260] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.140327 27345 ts_tablet_manager.cc:1428] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260807 11:09:43.206696 27363 raft_consensus.cc:482] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:43.207317 27363 raft_consensus.cc:504] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.212265 27363 leader_election.cc:288] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
I20260807 11:09:43.240597 27374 raft_consensus.cc:482] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:43.241163 27374 raft_consensus.cc:504] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.244215 27374 leader_election.cc:288] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:43.267748 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65810618a1924caba9ee34759e8d23c8" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc" is_pre_election: true
I20260807 11:09:43.268040 26997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65810618a1924caba9ee34759e8d23c8" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" is_pre_election: true
I20260807 11:09:43.268726 26786 raft_consensus.cc:2454] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 0.
I20260807 11:09:43.268888 26997 raft_consensus.cc:2454] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 0.
I20260807 11:09:43.270272 27106 leader_election.cc:302] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, 8309fc2e61b043479ade345c383361cc; no voters:
I20260807 11:09:43.271154 27363 raft_consensus.cc:2781] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:43.271500 27363 raft_consensus.cc:482] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:43.271788 27363 raft_consensus.cc:3037] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.279040 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a0e9b9e5f14459382c6497146e7a0c7" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc" is_pre_election: true
I20260807 11:09:43.279646 26786 raft_consensus.cc:2454] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 0.
I20260807 11:09:43.280856 26903 leader_election.cc:302] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:43.281801 27374 raft_consensus.cc:2781] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:43.282148 27374 raft_consensus.cc:482] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:43.282490 27374 raft_consensus.cc:3037] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.282507 27363 raft_consensus.cc:504] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.284400 27363 leader_election.cc:288] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 election: Requested vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
I20260807 11:09:43.286629 26997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65810618a1924caba9ee34759e8d23c8" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
I20260807 11:09:43.287199 26997 raft_consensus.cc:3037] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.291817 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a0e9b9e5f14459382c6497146e7a0c7" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8" is_pre_election: true
I20260807 11:09:43.292650 27198 raft_consensus.cc:2454] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 0.
I20260807 11:09:43.294526 27374 raft_consensus.cc:504] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.295606 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65810618a1924caba9ee34759e8d23c8" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc"
I20260807 11:09:43.296232 26786 raft_consensus.cc:3037] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.302197 26997 raft_consensus.cc:2454] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 1.
I20260807 11:09:43.302753 26786 raft_consensus.cc:2454] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 1.
I20260807 11:09:43.303380 27106 leader_election.cc:302] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:43.304646 27363 raft_consensus.cc:2781] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:43.305454 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a0e9b9e5f14459382c6497146e7a0c7" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc"
I20260807 11:09:43.305982 27374 leader_election.cc:288] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 election: Requested vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:43.306602 26786 raft_consensus.cc:3037] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.306890 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a0e9b9e5f14459382c6497146e7a0c7" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8"
I20260807 11:09:43.307437 27198 raft_consensus.cc:3037] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.313558 26786 raft_consensus.cc:2454] T 6a0e9b9e5f14459382c6497146e7a0c7 P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 1.
I20260807 11:09:43.313993 27198 raft_consensus.cc:2454] T 6a0e9b9e5f14459382c6497146e7a0c7 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 1.
I20260807 11:09:43.316172 26903 leader_election.cc:302] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:43.317077 27374 raft_consensus.cc:2781] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:43.323071 27363 raft_consensus.cc:686] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 LEADER]: Becoming Leader. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Running, Role: LEADER
I20260807 11:09:43.324237 27363 consensus_queue.cc:237] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.328512 27374 raft_consensus.cc:686] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 LEADER]: Becoming Leader. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Running, Role: LEADER
I20260807 11:09:43.329485 27374 consensus_queue.cc:237] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
W20260807 11:09:43.334884 26899 connection.cc:535] server connection from 127.0.0.1:41028 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:43.335891 26904 connection.cc:535] client connection to 127.22.115.254:33273 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:43.335932 26350 connection.cc:535] server connection from 127.0.0.1:42334 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:43.335916 27275 connection.cc:535] client connection to 127.22.115.254:33273 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:43.338121 27275 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.22.115.254:33273)
W20260807 11:09:43.339231 27108 connection.cc:535] server connection from 127.0.0.1:49024 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:43.339717 27108 connection.cc:535] client connection to 127.22.115.254:33273 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:43.340512 26683 connection.cc:535] server connection from 127.0.0.1:43238 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:43.349617 27275 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.115.254:33273)
W20260807 11:09:43.352589 27275 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.22.115.254:33273)
W20260807 11:09:43.353884 27275 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.22.115.254:33273)
W20260807 11:09:43.410903 27356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:43.411543 27356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:43.412021 27356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 11:09:43.445926 27356 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260807 11:09:43.446208 27356 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260807 11:09:43.446453 27356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:09:43.446695 27356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:43.446959 27356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:09:43.447192 27356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:09:43.465968 27423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ef9afb7003a447087f387b3eab9ee86)
I20260807 11:09:43.466322 27423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:43.468042 27423 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:43.473418 26354 leader_election.cc:334] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
W20260807 11:09:43.473869 26352 leader_election.cc:334] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:43.474217 26352 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:43.474833 27423 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 11:09:43.489881 27356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:45587
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.252:37249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.115.252
--webserver_port=38673
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:43.491187 27356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:43.492763 27356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:09:43.515405 27431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:43.544160 27374 raft_consensus.cc:482] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:43.544654 27374 raft_consensus.cc:504] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.546494 27374 leader_election.cc:288] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
W20260807 11:09:43.548424 26903 leader_election.cc:341] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08
I20260807 11:09:43.548847 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4493bdc609d64b5faec420679a9bef08" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8" is_pre_election: true
I20260807 11:09:43.549440 27198 raft_consensus.cc:2454] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 0.
I20260807 11:09:43.550508 26899 leader_election.cc:302] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, e13176e9c2f34e6087bc6b57aac0ade3; no voters: 8309fc2e61b043479ade345c383361cc
I20260807 11:09:43.551541 27374 raft_consensus.cc:2781] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:43.551847 27374 raft_consensus.cc:482] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:43.552134 27374 raft_consensus.cc:3037] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.560441 27374 raft_consensus.cc:504] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
W20260807 11:09:43.563580 26903 leader_election.cc:341] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08
I20260807 11:09:43.565847 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4493bdc609d64b5faec420679a9bef08" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8"
I20260807 11:09:43.566385 27198 raft_consensus.cc:3037] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.569419 27374 leader_election.cc:288] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 election: Requested vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:43.572111 27198 raft_consensus.cc:2454] T 4493bdc609d64b5faec420679a9bef08 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 1.
I20260807 11:09:43.572947 26899 leader_election.cc:302] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, e13176e9c2f34e6087bc6b57aac0ade3; no voters: 8309fc2e61b043479ade345c383361cc
I20260807 11:09:43.573554 27374 raft_consensus.cc:2781] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:43.573964 27374 raft_consensus.cc:686] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 LEADER]: Becoming Leader. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Running, Role: LEADER
I20260807 11:09:43.575371 27374 consensus_queue.cc:237] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:43.715026 27363 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:43.715489 27363 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:43.717360 27363 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:09:43.720299 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:09:43.722491 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:09:43.722958 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:09:43.723992 27363 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:43.745373 27437 raft_consensus.cc:482] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:43.745973 27437 raft_consensus.cc:504] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.749579 27437 leader_election.cc:288] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:43.766404 27363 raft_consensus.cc:482] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:43.766353 26997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" is_pre_election: true
I20260807 11:09:43.767148 26997 raft_consensus.cc:2454] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8309fc2e61b043479ade345c383361cc in term 0.
I20260807 11:09:43.767055 27363 raft_consensus.cc:504] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.769039 27363 leader_election.cc:288] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309), 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907)
I20260807 11:09:43.769229 26682 leader_election.cc:302] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:43.770360 27437 raft_consensus.cc:2781] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:43.770756 27437 raft_consensus.cc:482] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:43.770891 26997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" is_pre_election: true
I20260807 11:09:43.771183 27437 raft_consensus.cc:3037] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.771466 26997 raft_consensus.cc:2454] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 0.
I20260807 11:09:43.772552 27106 leader_election.cc:302] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:43.773512 27363 raft_consensus.cc:2781] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:43.773864 27363 raft_consensus.cc:482] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:43.774191 27363 raft_consensus.cc:3037] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.777952 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc" is_pre_election: true
I20260807 11:09:43.778927 27437 raft_consensus.cc:504] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.779614 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8" is_pre_election: true
I20260807 11:09:43.780267 26786 raft_consensus.cc:2379] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2db2a74f0f644f409db457a35ecf95e8 in current term 1: Already voted for candidate 8309fc2e61b043479ade345c383361cc in this term.
I20260807 11:09:43.781394 27363 raft_consensus.cc:504] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.782590 27198 raft_consensus.cc:2379] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8309fc2e61b043479ade345c383361cc in current term 1: Already voted for candidate 2db2a74f0f644f409db457a35ecf95e8 in this term.
I20260807 11:09:43.784911 26997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
I20260807 11:09:43.785495 26997 raft_consensus.cc:3037] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:43.785691 27197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8"
I20260807 11:09:43.786440 27197 raft_consensus.cc:2379] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8309fc2e61b043479ade345c383361cc in current term 1: Already voted for candidate 2db2a74f0f644f409db457a35ecf95e8 in this term.
I20260807 11:09:43.789984 27363 leader_election.cc:288] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 election: Requested vote from peers e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309), 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907)
I20260807 11:09:43.791296 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
I20260807 11:09:43.791779 26997 raft_consensus.cc:2454] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8309fc2e61b043479ade345c383361cc in term 1.
I20260807 11:09:43.782426 27437 leader_election.cc:288] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 election: Requested vote from peers e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:43.793344 26682 leader_election.cc:302] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:43.794411 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425d9ee4e1c4d3385a8e9a516c50ff2" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc"
I20260807 11:09:43.794714 27437 raft_consensus.cc:2781] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:43.795861 27437 raft_consensus.cc:686] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [term 1 LEADER]: Becoming Leader. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Running, Role: LEADER
I20260807 11:09:43.797403 27437 consensus_queue.cc:237] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } }
I20260807 11:09:43.804848 27106 leader_election.cc:302] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:09:43.805716 27363 raft_consensus.cc:2726] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 11:09:44.203752 27444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ef9afb7003a447087f387b3eab9ee86)
I20260807 11:09:44.204136 27444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:44.205648 27444 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:44.215276 26352 leader_election.cc:334] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:09:44.215945 26354 leader_election.cc:334] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
I20260807 11:09:44.216252 26354 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a; no voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:44.216841 27444 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 11:09:44.313649 27454 consensus_queue.cc:1035] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:44.346833 27460 consensus_queue.cc:1035] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:44.362316 27463 consensus_queue.cc:1035] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:44.381846 27459 consensus_queue.cc:1035] T 6a0e9b9e5f14459382c6497146e7a0c7 P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 11:09:44.602150 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:43.518771 27356 server_base.cc:1034] running on GCE node
W20260807 11:09:43.523840 27428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:43.522244 27433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:44.744453 27356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:44.747087 27356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:44.748476 27356 hybrid_clock.cc:648] HybridClock initialized: now 1786100984748427 us; error 39 us; skew 500 ppm
I20260807 11:09:44.749372 27356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:44.755853 27356 webserver.cc:460] Webserver started at http://127.22.115.252:38673/ using document root <none> and password file <none>
I20260807 11:09:44.756771 27356 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:44.756999 27356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:44.765256 27356 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 11:09:44.770174 27481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:44.771359 27356 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 11:09:44.771658 27356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
uuid: "fda42d40a62841349371a2ca0bd85a37"
format_stamp: "Formatted at 2026-08-07 11:09:34 on dist-test-slave-5bn2"
I20260807 11:09:44.773981 27356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:44.817775 27356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:44.819289 27356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:44.819702 27356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:44.828763 27463 consensus_queue.cc:1035] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:44.900647 27456 consensus_queue.cc:1035] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:44.931759 27356 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.252:37249
I20260807 11:09:44.931941 27568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.252:37249 every 8 connection(s)
I20260807 11:09:44.932729 27560 consensus_queue.cc:1035] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 8309fc2e61b043479ade345c383361cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 11:09:44.935999 27356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-2/data/info.pb
I20260807 11:09:44.942540 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 27356
I20260807 11:09:44.994174 27063 heartbeater.cc:347] Connected to a master server at 127.22.115.252:37249
I20260807 11:09:45.000558 26852 heartbeater.cc:347] Connected to a master server at 127.22.115.252:37249
I20260807 11:09:45.009595 27570 sys_catalog.cc:263] Verifying existing consensus state
I20260807 11:09:45.015013 27570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Bootstrap starting.
I20260807 11:09:45.026621 27570 log.cc:824] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Log is configured to *not* fsync() on all Append() calls
I20260807 11:09:45.041060 27570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 11:09:45.041795 27570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Bootstrap complete.
I20260807 11:09:45.051227 27579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ef9afb7003a447087f387b3eab9ee86)
I20260807 11:09:45.051579 27579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:45.052966 27579 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:45.061538 26354 leader_election.cc:334] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
I20260807 11:09:45.064987 27570 raft_consensus.cc:348] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:45.068037 27570 raft_consensus.cc:729] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda42d40a62841349371a2ca0bd85a37, State: Initialized, Role: FOLLOWER
I20260807 11:09:45.068965 27570 consensus_queue.cc:260] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:45.071708 27585 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:45.072516 27585 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:45.073107 27570 sys_catalog.cc:564] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:09:45.073235 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 16 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37" is_pre_election: true
I20260807 11:09:45.074007 27530 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79d274e2557344d4a38dfb83e8438d1a in term 1.
I20260807 11:09:45.075016 26352 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37; no voters: 6ef9afb7003a447087f387b3eab9ee86
I20260807 11:09:45.075989 27579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 11:09:45.076292 27579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ef9afb7003a447087f387b3eab9ee86)
I20260807 11:09:45.076649 27579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 2 FOLLOWER]: Advancing to term 3
I20260807 11:09:45.083170 27579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:45.085870 27579 leader_election.cc:288] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 election: Requested vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
I20260807 11:09:45.086930 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79d274e2557344d4a38dfb83e8438d1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 16 } } ignore_live_leader: false dest_uuid: "fda42d40a62841349371a2ca0bd85a37"
I20260807 11:09:45.087522 27530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 1 FOLLOWER]: Advancing to term 3
W20260807 11:09:45.088251 26354 leader_election.cc:334] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
I20260807 11:09:45.096321 27530 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79d274e2557344d4a38dfb83e8438d1a in term 3.
I20260807 11:09:45.097187 26352 leader_election.cc:302] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37; no voters: 6ef9afb7003a447087f387b3eab9ee86
I20260807 11:09:45.097805 27579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 11:09:45.099058 27579 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [term 3 LEADER]: Becoming Leader. State: Replica: 79d274e2557344d4a38dfb83e8438d1a, State: Running, Role: LEADER
I20260807 11:09:45.099989 27579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 2.16, Last appended by leader: 16, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:45.105360 27601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79d274e2557344d4a38dfb83e8438d1a. Latest consensus state: current_term: 3 leader_uuid: "79d274e2557344d4a38dfb83e8438d1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:45.106132 27601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:45.134933 27610 catalog_manager.cc:1259] Loaded cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:45.135210 27610 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: loading cluster ID for follower catalog manager: success
I20260807 11:09:45.139173 27612 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 11:09:45.143158 27610 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: acquiring CA information for follower catalog manager: success
I20260807 11:09:45.148838 27612 catalog_manager.cc:669] Loaded metadata for table default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]
I20260807 11:09:45.149223 27610 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 11:09:45.150705 27612 catalog_manager.cc:669] Loaded metadata for table default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]
I20260807 11:09:45.152350 27612 catalog_manager.cc:669] Loaded metadata for table default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]
I20260807 11:09:45.121796 27356 master_runner.cc:186] Error getting master registration for 127.22.115.254:33273: Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111),
I20260807 11:09:45.153005 27356 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:09:45.159925 27612 tablet_loader.cc:96] loaded metadata for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2 (table default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2])
I20260807 11:09:45.161933 27612 tablet_loader.cc:96] loaded metadata for tablet 460762af742048438f8a0f014eb64f4b (table default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785])
I20260807 11:09:45.163187 27612 tablet_loader.cc:96] loaded metadata for tablet 65810618a1924caba9ee34759e8d23c8 (table default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2])
I20260807 11:09:45.165333 27612 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 11:09:45.169866 27612 catalog_manager.cc:1259] Loaded cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:45.170130 27612 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 11:09:45.175691 27612 catalog_manager.cc:1504] Loading token signing keys...
I20260807 11:09:45.180047 27612 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: Loaded TSK: 0
I20260807 11:09:45.181802 27612 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 11:09:45.186091 27612 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260807 11:09:45.190207 27612 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260807 11:09:45.230186 27530 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Refusing update from remote peer 79d274e2557344d4a38dfb83e8438d1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 18. (index mismatch)
I20260807 11:09:45.231786 27579 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 11:09:45.232498 26354 consensus_peers.cc:487] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a -> Peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Couldn't send request to peer 6ef9afb7003a447087f387b3eab9ee86. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:45.246599 26375 master_service.cc:946] ReplaceTablet: received request to replace tablet 6a0e9b9e5f14459382c6497146e7a0c7 from {username='slave'} at 127.0.0.1:35254
I20260807 11:09:45.251248 26373 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35254:
name: "default.Table_937417113ef94762a2763376d99a2f2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:45.252400 26370 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35254:
name: "default.Table_5f08f5483b4e4b69af546b339cc1f064"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:45.253090 26369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35254:
table { table_name: "default.Table_2dcda62b2c384802b0be6b568b499c9e" } modify_external_catalogs: true
I20260807 11:09:45.253885 26366 master_service.cc:946] ReplaceTablet: received request to replace tablet 6a0e9b9e5f14459382c6497146e7a0c7 from {username='slave'} at 127.0.0.1:35254
I20260807 11:09:45.253966 26369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35254:
table { table_name: "default.Table_2dcda62b2c384802b0be6b568b499c9e" } modify_external_catalogs: true
I20260807 11:09:45.253137 26375 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35254:
name: "default.Table_54143a9db286438995e80f4662d9c52b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:45.251134 26372 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35254:
name: "default.Table_9d2e3b5c1bee4b7aa5ed25dbeec04f42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:45.256021 26365 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35254:
table { table_name: "default.Table_cef4ae08a7e64e10aa23c07621f7983b" } new_table_name: "default.Table_cc7b52ebb5b8493d8a72b9e9073d6cfa" modify_external_catalogs: true
I20260807 11:09:45.256107 26362 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35254:
table { table_name: "default.Table_cc398fbd66d84034990dd646a25d8ccd" } new_table_name: "default.Table_3162e0d20d2d4ea5be08d1b23d21ffcb" modify_external_catalogs: true
F20260807 11:09:45.264019 26640 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_7c2b24407f7e4d128d948b0dde1601f7
*** Check failure stack trace: ***
@ 0x7fc2a328c9a0 google::LogMessage::Flush() at ??:0
I20260807 11:09:45.295820 27625 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "79d274e2557344d4a38dfb83e8438d1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:45.296640 27625 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:45.297765 27585 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79d274e2557344d4a38dfb83e8438d1a. Latest consensus state: current_term: 3 leader_uuid: "79d274e2557344d4a38dfb83e8438d1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:45.298413 27585 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fc2a328c70f google::LogMessage::~LogMessage() at ??:0
I20260807 11:09:45.301052 27620 mvcc.cc:205] Tried to move back new op lower bound from 7315869635488235520 to 7315869634979102720. Current Snapshot: MvccSnapshot[applied={T|T < 7315869635488235520}]
I20260807 11:09:45.307126 27621 mvcc.cc:205] Tried to move back new op lower bound from 7315869626152226816 to 7315869621648891904. Current Snapshot: MvccSnapshot[applied={T|T < 7315869625722224640 or (T in {7315869626152226816})}]
I20260807 11:09:45.309288 27585 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "79d274e2557344d4a38dfb83e8438d1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:45.309983 27585 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:45.354549 27601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "79d274e2557344d4a38dfb83e8438d1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:45.355419 27601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a [sys.catalog]: This master's current role is: LEADER
@ 0x7fc2ae327aea kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260807 11:09:45.385699 27167 tablet_service.cc:1467] Processing CreateTablet for tablet 460762af742048438f8a0f014eb64f4b (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:45.386819 27167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 460762af742048438f8a0f014eb64f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:45.390774 26756 tablet_service.cc:1467] Processing CreateTablet for tablet 460762af742048438f8a0f014eb64f4b (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:45.391839 26756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 460762af742048438f8a0f014eb64f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:45.398203 26965 tablet_service.cc:1467] Processing CreateTablet for tablet 460762af742048438f8a0f014eb64f4b (DEFAULT_TABLE table=default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:45.399298 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 460762af742048438f8a0f014eb64f4b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc2ae32733c kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260807 11:09:45.443784 27649 tablet_bootstrap.cc:492] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
I20260807 11:09:45.445715 27656 tablet_bootstrap.cc:492] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
I20260807 11:09:45.449962 27649 tablet_bootstrap.cc:654] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
@ 0x7fc2ae32afd2 kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260807 11:09:45.470280 26366 master_service.cc:946] ReplaceTablet: received request to replace tablet 65810618a1924caba9ee34759e8d23c8 from {username='slave'} at 127.0.0.1:35254
I20260807 11:09:45.473886 27259 heartbeater.cc:503] Master 127.22.115.253:45313 was elected leader, sending a full tablet report...
I20260807 11:09:45.476186 27649 tablet_bootstrap.cc:492] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:45.476650 27649 ts_tablet_manager.cc:1397] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.007s
W20260807 11:09:45.489401 26361 catalog_manager.cc:5328] Ignoring report from unknown tablet 6a0e9b9e5f14459382c6497146e7a0c7
W20260807 11:09:45.489703 26361 catalog_manager.cc:5328] Ignoring report from unknown tablet 237991fbd81a47a58865556f63bce2cf
W20260807 11:09:45.489893 26361 catalog_manager.cc:5328] Ignoring report from unknown tablet 4493bdc609d64b5faec420679a9bef08
I20260807 11:09:45.495736 26360 master_service.cc:946] ReplaceTablet: received request to replace tablet 65810618a1924caba9ee34759e8d23c8 from {username='slave'} at 127.0.0.1:35254
I20260807 11:09:45.497107 27649 raft_consensus.cc:348] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.497800 27649 raft_consensus.cc:374] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:45.498071 27649 raft_consensus.cc:729] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:45.498766 27649 consensus_queue.cc:260] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.500716 27656 tablet_bootstrap.cc:654] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:45.507243 27258 heartbeater.cc:347] Connected to a master server at 127.22.115.252:37249
I20260807 11:09:45.507736 27258 heartbeater.cc:503] Master 127.22.115.252:37249 was elected leader, sending a full tablet report...
I20260807 11:09:45.510661 27649 ts_tablet_manager.cc:1428] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
@ 0x7fc2ae32af8a _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
I20260807 11:09:45.532006 27512 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" instance_seqno: 1786100981453406) as {username='slave'} at 127.22.115.195:36957; Asking this server to re-register.
I20260807 11:09:45.533937 27258 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:45.536863 27516 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" instance_seqno: 1786100979621039) as {username='slave'} at 127.22.115.194:37607; Asking this server to re-register.
I20260807 11:09:45.539016 27063 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:45.544180 27656 tablet_bootstrap.cc:492] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:45.544579 27656 ts_tablet_manager.cc:1397] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.099s user 0.009s sys 0.003s
I20260807 11:09:45.547027 27656 raft_consensus.cc:348] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.547679 27656 raft_consensus.cc:374] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:45.547938 27656 raft_consensus.cc:729] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:45.548641 27656 consensus_queue.cc:260] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.550099 27065 heartbeater.cc:503] Master 127.22.115.253:45313 was elected leader, sending a full tablet report...
I20260807 11:09:45.550926 27656 ts_tablet_manager.cc:1428] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260807 11:09:45.550800 27513 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "8309fc2e61b043479ade345c383361cc" instance_seqno: 1786100977609659) as {username='slave'} at 127.22.115.193:47377; Asking this server to re-register.
I20260807 11:09:45.552403 27516 ts_manager.cc:194] Registered new tserver with Master: 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:45.552824 26852 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:45.553268 27512 ts_manager.cc:194] Registered new tserver with Master: e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
I20260807 11:09:45.550104 26361 catalog_manager.cc:5495] T 4425d9ee4e1c4d3385a8e9a516c50ff2 P 2db2a74f0f644f409db457a35ecf95e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8309fc2e61b043479ade345c383361cc (127.22.115.193). New cstate: current_term: 1 leader_uuid: "8309fc2e61b043479ade345c383361cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } }
W20260807 11:09:45.565085 26360 catalog_manager.cc:5328] Ignoring report from unknown tablet 6a0e9b9e5f14459382c6497146e7a0c7
W20260807 11:09:45.565640 26360 catalog_manager.cc:5328] Ignoring report from unknown tablet 4493bdc609d64b5faec420679a9bef08
I20260807 11:09:45.577221 27668 tablet_bootstrap.cc:492] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
@ 0x7fc2ae32af1a std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260807 11:09:45.590910 27668 tablet_bootstrap.cc:654] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:45.592545 26366 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79d274e2557344d4a38dfb83e8438d1a: Sending DeleteTablet for 3 replicas of tablet 65810618a1924caba9ee34759e8d23c8
I20260807 11:09:45.595072 26756 tablet_service.cc:1514] Processing DeleteTablet for tablet 65810618a1924caba9ee34759e8d23c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 15bae401abfc4af89fdeb12ddde315ea) from {username='slave'} at 127.0.0.1:43242
I20260807 11:09:45.595598 27167 tablet_service.cc:1514] Processing DeleteTablet for tablet 65810618a1924caba9ee34759e8d23c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 15bae401abfc4af89fdeb12ddde315ea) from {username='slave'} at 127.0.0.1:49036
I20260807 11:09:45.597012 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 65810618a1924caba9ee34759e8d23c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 15bae401abfc4af89fdeb12ddde315ea) from {username='slave'} at 127.0.0.1:41040
I20260807 11:09:45.599025 27512 ts_manager.cc:194] Registered new tserver with Master: 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907)
I20260807 11:09:45.608572 27676 tablet_replica.cc:330] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: stopping tablet replica
I20260807 11:09:45.609364 27676 raft_consensus.cc:2229] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:45.609867 27676 raft_consensus.cc:2258] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:45.613379 27674 tablet_replica.cc:330] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: stopping tablet replica
I20260807 11:09:45.618736 27672 tablet_replica.cc:330] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: stopping tablet replica
I20260807 11:09:45.619764 27672 raft_consensus.cc:2229] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:45.620496 27672 raft_consensus.cc:2258] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7fc2ae32aee2 std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260807 11:09:45.623951 27672 ts_tablet_manager.cc:1905] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:45.625630 27668 tablet_bootstrap.cc:492] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:45.626056 27668 ts_tablet_manager.cc:1397] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.052s user 0.009s sys 0.019s
I20260807 11:09:45.611747 27676 ts_tablet_manager.cc:1905] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:45.636308 27674 raft_consensus.cc:2229] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:09:45.637377 27674 raft_consensus.cc:2258] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:45.639057 27672 ts_tablet_manager.cc:1918] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:45.639500 27672 log.cc:1196] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/65810618a1924caba9ee34759e8d23c8
I20260807 11:09:45.640441 27672 ts_tablet_manager.cc:1939] T 65810618a1924caba9ee34759e8d23c8 P 8309fc2e61b043479ade345c383361cc: Deleting consensus metadata
I20260807 11:09:45.644919 26756 tablet_service.cc:1467] Processing CreateTablet for tablet 15bae401abfc4af89fdeb12ddde315ea (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:45.645327 26353 catalog_manager.cc:4841] TS 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): tablet 65810618a1924caba9ee34759e8d23c8 (table default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]) successfully deleted
I20260807 11:09:45.646127 26756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15bae401abfc4af89fdeb12ddde315ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:45.647740 26965 tablet_service.cc:1467] Processing CreateTablet for tablet 15bae401abfc4af89fdeb12ddde315ea (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7fc2ae32a1de std::__1::__function::__func<>::operator()() at ??:0
I20260807 11:09:45.648914 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15bae401abfc4af89fdeb12ddde315ea. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x580785 std::__1::__function::__value_func<>::operator()() at ??:?
I20260807 11:09:45.649389 27668 raft_consensus.cc:348] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.651098 27668 raft_consensus.cc:374] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:45.651404 27668 raft_consensus.cc:729] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
@ 0x5805ba std::__1::function<>::operator()() at ??:?
I20260807 11:09:45.652061 27668 consensus_queue.cc:260] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.659011 26366 catalog_manager.cc:6565] ReplaceTablet: tablet 65810618a1924caba9ee34759e8d23c8 deleted and replaced by tablet 15bae401abfc4af89fdeb12ddde315ea
I20260807 11:09:45.668684 27167 tablet_service.cc:1467] Processing CreateTablet for tablet 15bae401abfc4af89fdeb12ddde315ea (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:45.669878 27167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15bae401abfc4af89fdeb12ddde315ea. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc2a543ddc7 kudu::Thread::SuperviseThread() at ??:0
@ 0x4230f0 __tsan_thread_start_func at ??:?
W20260807 11:09:45.688591 26360 catalog_manager.cc:5328] Ignoring report from unknown tablet 6a0e9b9e5f14459382c6497146e7a0c7
I20260807 11:09:45.688617 27674 ts_tablet_manager.cc:1905] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fc2a6aab6db start_thread at ??:0
I20260807 11:09:45.707312 27649 tablet_bootstrap.cc:492] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
@ 0x7fc2a1f3161f clone at ??:0
I20260807 11:09:45.723875 27656 tablet_bootstrap.cc:492] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
I20260807 11:09:45.728163 27676 ts_tablet_manager.cc:1918] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:45.729717 27676 log.cc:1196] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/65810618a1924caba9ee34759e8d23c8
I20260807 11:09:45.731221 27676 ts_tablet_manager.cc:1939] T 65810618a1924caba9ee34759e8d23c8 P e13176e9c2f34e6087bc6b57aac0ade3: Deleting consensus metadata
I20260807 11:09:45.733004 27656 tablet_bootstrap.cc:654] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:45.740957 27649 tablet_bootstrap.cc:654] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:45.755177 26853 heartbeater.cc:503] Master 127.22.115.253:45313 was elected leader, sending a full tablet report...
I20260807 11:09:45.763123 27668 ts_tablet_manager.cc:1428] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.137s user 0.034s sys 0.048s
I20260807 11:09:45.772785 27668 tablet_bootstrap.cc:492] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
I20260807 11:09:45.778703 27668 tablet_bootstrap.cc:654] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:45.784740 27668 tablet_bootstrap.cc:492] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:45.785152 27668 ts_tablet_manager.cc:1397] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.002s
I20260807 11:09:45.787876 27668 raft_consensus.cc:348] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.788794 27668 raft_consensus.cc:374] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:45.789079 27668 raft_consensus.cc:729] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
I20260807 11:09:45.789871 27668 consensus_queue.cc:260] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.792521 27668 ts_tablet_manager.cc:1428] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260807 11:09:45.794384 27649 tablet_bootstrap.cc:492] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:45.794782 27649 ts_tablet_manager.cc:1397] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.011s
I20260807 11:09:45.799690 27649 raft_consensus.cc:348] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.800369 27649 raft_consensus.cc:374] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:45.800628 27649 raft_consensus.cc:729] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:45.801367 27649 consensus_queue.cc:260] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.805466 27656 tablet_bootstrap.cc:492] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:45.805833 27656 ts_tablet_manager.cc:1397] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.082s user 0.009s sys 0.004s
I20260807 11:09:45.808095 27656 raft_consensus.cc:348] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.808722 27656 raft_consensus.cc:374] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:45.808954 27656 raft_consensus.cc:729] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:45.816089 27649 ts_tablet_manager.cc:1428] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260807 11:09:45.819154 27656 consensus_queue.cc:260] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.821218 27656 ts_tablet_manager.cc:1428] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260807 11:09:45.828660 27674 ts_tablet_manager.cc:1918] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:45.829067 27674 log.cc:1196] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/65810618a1924caba9ee34759e8d23c8
I20260807 11:09:45.829998 27674 ts_tablet_manager.cc:1939] T 65810618a1924caba9ee34759e8d23c8 P 2db2a74f0f644f409db457a35ecf95e8: Deleting consensus metadata
I20260807 11:09:45.831820 27651 raft_consensus.cc:482] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:45.832258 27651 raft_consensus.cc:504] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.834184 27651 leader_election.cc:288] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
I20260807 11:09:45.836630 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460762af742048438f8a0f014eb64f4b" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc" is_pre_election: true
I20260807 11:09:45.837402 26786 raft_consensus.cc:2454] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 0.
I20260807 11:09:45.838542 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460762af742048438f8a0f014eb64f4b" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" is_pre_election: true
I20260807 11:09:45.839172 26996 raft_consensus.cc:2454] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 0.
I20260807 11:09:45.840404 27106 leader_election.cc:302] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, 8309fc2e61b043479ade345c383361cc; no voters:
I20260807 11:09:45.842156 27651 raft_consensus.cc:2781] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:45.842463 27651 raft_consensus.cc:482] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:45.842741 27651 raft_consensus.cc:3037] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:45.852413 27651 raft_consensus.cc:504] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.863988 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460762af742048438f8a0f014eb64f4b" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc"
I20260807 11:09:45.864524 26786 raft_consensus.cc:3037] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:45.871212 26786 raft_consensus.cc:2454] T 460762af742048438f8a0f014eb64f4b P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 1.
I20260807 11:09:45.872265 27106 leader_election.cc:302] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, 8309fc2e61b043479ade345c383361cc; no voters:
I20260807 11:09:45.873205 27660 raft_consensus.cc:2781] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:45.873700 27660 raft_consensus.cc:686] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [term 1 LEADER]: Becoming Leader. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Running, Role: LEADER
I20260807 11:09:45.874475 27660 consensus_queue.cc:237] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:45.883628 27651 leader_election.cc:288] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 election: Requested vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
I20260807 11:09:45.885371 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "460762af742048438f8a0f014eb64f4b" candidate_uuid: "2db2a74f0f644f409db457a35ecf95e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
I20260807 11:09:45.885901 26996 raft_consensus.cc:3037] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:45.894949 26996 raft_consensus.cc:2454] T 460762af742048438f8a0f014eb64f4b P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db2a74f0f644f409db457a35ecf95e8 in term 1.
W20260807 11:09:46.008770 26897 connection.cc:535] server connection from 127.0.0.1:41040 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:46.008862 27272 connection.cc:535] client connection to 127.22.115.253:45313 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:46.009518 26897 connection.cc:535] client connection to 127.22.115.253:45313 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:46.009569 27103 connection.cc:535] client connection to 127.22.115.253:45313 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:46.010390 27105 connection.cc:535] server connection from 127.0.0.1:49036 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:46.011102 27272 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.22.115.253:45313)
W20260807 11:09:46.011126 26680 connection.cc:535] client connection to 127.22.115.253:45313 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:46.011926 27272 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.22.115.253:45313)
W20260807 11:09:46.013144 27272 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.22.115.253:45313)
W20260807 11:09:46.013866 27272 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.115.253:45313)
I20260807 11:09:46.129383 27697 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d274e2557344d4a38dfb83e8438d1a)
I20260807 11:09:46.129763 27697 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:46.132376 27697 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
W20260807 11:09:46.134089 27486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
W20260807 11:09:46.140748 27482 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:46.141212 27486 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
I20260807 11:09:46.141567 27486 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda42d40a62841349371a2ca0bd85a37; no voters: 6ef9afb7003a447087f387b3eab9ee86, 79d274e2557344d4a38dfb83e8438d1a
I20260807 11:09:46.142187 27697 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 11:09:46.387642 27677 raft_consensus.cc:482] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:46.388123 27677 raft_consensus.cc:504] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:46.390007 27677 leader_election.cc:288] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:46.390933 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bae401abfc4af89fdeb12ddde315ea" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc" is_pre_election: true
I20260807 11:09:46.391536 26786 raft_consensus.cc:2454] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 0.
I20260807 11:09:46.391500 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bae401abfc4af89fdeb12ddde315ea" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8" is_pre_election: true
I20260807 11:09:46.392095 27198 raft_consensus.cc:2454] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 0.
I20260807 11:09:46.392481 26903 leader_election.cc:302] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:46.393204 27677 raft_consensus.cc:2781] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:46.393517 27677 raft_consensus.cc:482] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:46.393916 27677 raft_consensus.cc:3037] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:46.400326 27677 raft_consensus.cc:504] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:46.402997 26786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bae401abfc4af89fdeb12ddde315ea" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8309fc2e61b043479ade345c383361cc"
I20260807 11:09:46.403160 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bae401abfc4af89fdeb12ddde315ea" candidate_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8"
I20260807 11:09:46.403542 26786 raft_consensus.cc:3037] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:46.403683 27198 raft_consensus.cc:3037] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:46.409603 27677 leader_election.cc:288] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 election: Requested vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:46.409695 27198 raft_consensus.cc:2454] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 1.
I20260807 11:09:46.409708 26786 raft_consensus.cc:2454] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e13176e9c2f34e6087bc6b57aac0ade3 in term 1.
I20260807 11:09:46.410765 26899 leader_election.cc:302] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:46.411616 27677 raft_consensus.cc:2781] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:46.412536 27677 raft_consensus.cc:686] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 LEADER]: Becoming Leader. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Running, Role: LEADER
I20260807 11:09:46.414222 27677 consensus_queue.cc:237] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:46.659448 27714 consensus_queue.cc:1035] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:46.678923 27715 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d274e2557344d4a38dfb83e8438d1a)
I20260807 11:09:46.679373 27715 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:46.688661 27715 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
W20260807 11:09:46.704820 27482 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:46.709167 27486 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
I20260807 11:09:46.709656 27486 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda42d40a62841349371a2ca0bd85a37; no voters: 6ef9afb7003a447087f387b3eab9ee86, 79d274e2557344d4a38dfb83e8438d1a
I20260807 11:09:46.710425 27715 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 11:09:46.712286 27714 consensus_queue.cc:1035] T 460762af742048438f8a0f014eb64f4b P 2db2a74f0f644f409db457a35ecf95e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:47.238425 27677 consensus_queue.cc:1035] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:47.262094 27677 consensus_queue.cc:1035] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:47.299662 27745 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d274e2557344d4a38dfb83e8438d1a)
I20260807 11:09:47.300056 27745 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:47.301448 27745 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
W20260807 11:09:47.309722 27486 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
W20260807 11:09:47.314235 27482 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:47.314637 27482 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda42d40a62841349371a2ca0bd85a37; no voters: 6ef9afb7003a447087f387b3eab9ee86, 79d274e2557344d4a38dfb83e8438d1a
I20260807 11:09:47.315416 27745 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 11:09:47.594594 27739 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:47.595029 27739 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:47.596467 27739 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:09:47.598143 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:09:47.598891 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:09:47.599174 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:09:47.599686 27739 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:48.138998 22991 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
/tmp/dist-test-taskijOH_9/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.254:33273
--webserver_interface=127.22.115.254
--webserver_port=37277
--builtin_ntp_servers=127.22.115.212:45185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--hive_metastore_uris=thrift://127.0.0.1:45587
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260807 11:09:48.482877 27761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 11:09:48.483434 27761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 11:09:48.484071 27761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 11:09:48.505442 27788 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d274e2557344d4a38dfb83e8438d1a)
I20260807 11:09:48.505832 27788 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:48.517165 27788 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
W20260807 11:09:48.523305 27482 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:48.523854 27486 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273): Network error: Client connection negotiation failed: client connection to 127.22.115.254:33273: connect: Connection refused (error 111)
I20260807 11:09:48.524241 27486 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda42d40a62841349371a2ca0bd85a37; no voters: 6ef9afb7003a447087f387b3eab9ee86, 79d274e2557344d4a38dfb83e8438d1a
I20260807 11:09:48.524910 27788 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 11:09:48.534731 27761 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260807 11:09:48.535072 27761 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260807 11:09:48.535367 27761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 11:09:48.535614 27761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 11:09:48.535837 27761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 11:09:48.536063 27761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 11:09:48.575577 27761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.115.212:45185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:45587
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.115.254:33273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.115.254
--webserver_port=37277
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 10:26:28 UTC on ccycloud.quasar-pbxjyx.root.comops.site
build id 4572144
TSAN enabled
I20260807 11:09:48.576817 27761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 11:09:48.578428 27761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 11:09:48.597180 27796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:48.599800 27761 server_base.cc:1034] running on GCE node
W20260807 11:09:48.597190 27795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 11:09:48.598111 27800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 11:09:49.772013 27761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 11:09:49.774716 27761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 11:09:49.776085 27761 hybrid_clock.cc:648] HybridClock initialized: now 1786100989776047 us; error 49 us; skew 500 ppm
I20260807 11:09:49.776914 27761 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 11:09:49.783172 27761 webserver.cc:460] Webserver started at http://127.22.115.254:37277/ using document root <none> and password file <none>
I20260807 11:09:49.784093 27761 fs_manager.cc:359] Metadata directory not provided
I20260807 11:09:49.784310 27761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 11:09:49.793937 27761 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 11:09:49.798590 27843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 11:09:49.799613 27761 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 11:09:49.799925 27761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data,/tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
uuid: "6ef9afb7003a447087f387b3eab9ee86"
format_stamp: "Formatted at 2026-08-07 11:09:30 on dist-test-slave-5bn2"
I20260807 11:09:49.802246 27761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 11:09:49.839231 27761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 11:09:49.840881 27761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 11:09:49.841326 27761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 11:09:49.916350 27761 rpc_server.cc:307] RPC server started. Bound to: 127.22.115.254:33273
I20260807 11:09:49.916560 27921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.115.254:33273 every 8 connection(s)
I20260807 11:09:49.919270 27761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/master-0/data/info.pb
I20260807 11:09:49.929507 22991 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskijOH_9/build/tsan/bin/kudu as pid 27761
I20260807 11:09:49.930006 27923 sys_catalog.cc:263] Verifying existing consensus state
I20260807 11:09:49.938412 27923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Bootstrap starting.
I20260807 11:09:49.944628 27924 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79d274e2557344d4a38dfb83e8438d1a)
I20260807 11:09:49.945310 27924 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:49.947384 27924 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
I20260807 11:09:49.964663 27923 log.cc:824] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Log is configured to *not* fsync() on all Append() calls
W20260807 11:09:49.970041 27482 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:50.018388 27923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=12 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 11:09:50.019423 27923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: Bootstrap complete.
I20260807 11:09:50.044323 27923 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:50.046622 27923 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9afb7003a447087f387b3eab9ee86, State: Initialized, Role: FOLLOWER
I20260807 11:09:50.047505 27923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 2.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:50.050108 27938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:50.050707 27938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:50.051769 27923 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 11:09:50.051985 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 4 candidate_status { last_received { term: 3 index: 22 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86" is_pre_election: true
I20260807 11:09:50.052703 27888 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda42d40a62841349371a2ca0bd85a37 in term 2.
I20260807 11:09:50.053719 27486 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37; no voters: 79d274e2557344d4a38dfb83e8438d1a
I20260807 11:09:50.054836 27924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 11:09:50.055270 27924 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 79d274e2557344d4a38dfb83e8438d1a)
I20260807 11:09:50.055632 27924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 3 FOLLOWER]: Advancing to term 4
I20260807 11:09:50.061673 27924 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:50.064031 27924 leader_election.cc:288] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 election: Requested vote from peers 6ef9afb7003a447087f387b3eab9ee86 (127.22.115.254:33273), 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313)
I20260807 11:09:50.064353 27888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fda42d40a62841349371a2ca0bd85a37" candidate_term: 4 candidate_status { last_received { term: 3 index: 22 } } ignore_live_leader: false dest_uuid: "6ef9afb7003a447087f387b3eab9ee86"
I20260807 11:09:50.064951 27888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 2 FOLLOWER]: Advancing to term 4
W20260807 11:09:50.067533 27482 leader_election.cc:334] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:09:50.077219 27888 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda42d40a62841349371a2ca0bd85a37 in term 4.
I20260807 11:09:50.078459 27486 leader_election.cc:302] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86, fda42d40a62841349371a2ca0bd85a37; no voters: 79d274e2557344d4a38dfb83e8438d1a
I20260807 11:09:50.079668 27924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 11:09:50.081758 27924 raft_consensus.cc:686] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [term 4 LEADER]: Becoming Leader. State: Replica: fda42d40a62841349371a2ca0bd85a37, State: Running, Role: LEADER
I20260807 11:09:50.082813 27924 consensus_queue.cc:237] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 3.22, Last appended by leader: 22, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:50.084609 27068 heartbeater.cc:347] Connected to a master server at 127.22.115.254:33273
I20260807 11:09:50.102699 27953 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda42d40a62841349371a2ca0bd85a37. Latest consensus state: current_term: 4 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:50.103524 27953 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:50.105831 27961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 11:09:50.115496 27961 catalog_manager.cc:669] Loaded metadata for table default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785]
I20260807 11:09:50.117321 27961 catalog_manager.cc:669] Loaded metadata for table default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2]
I20260807 11:09:50.119166 27961 catalog_manager.cc:669] Loaded metadata for table default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]
I20260807 11:09:50.125557 27961 tablet_loader.cc:96] loaded metadata for tablet 15bae401abfc4af89fdeb12ddde315ea (table default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2])
I20260807 11:09:50.126791 27961 tablet_loader.cc:96] loaded metadata for tablet 4425d9ee4e1c4d3385a8e9a516c50ff2 (table default.table_cc398fbd66d84034990dd646a25d8ccd [id=177e77e7b54247ae8404f11de2cd6ec2])
I20260807 11:09:50.128010 27961 tablet_loader.cc:96] loaded metadata for tablet 460762af742048438f8a0f014eb64f4b (table default.table_cef4ae08a7e64e10aa23c07621f7983b [id=15a54eb515534d41a3a0f03753640785])
I20260807 11:09:50.129917 27961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 11:09:50.133855 27961 catalog_manager.cc:1259] Loaded cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:50.134092 27961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 11:09:50.139233 27961 catalog_manager.cc:1504] Loading token signing keys...
I20260807 11:09:50.142976 27973 catalog_manager.cc:1259] Loaded cluster ID: d8c74844c396485eac902a8fb6845965
I20260807 11:09:50.143164 27973 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: loading cluster ID for follower catalog manager: success
I20260807 11:09:50.143498 27961 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Loaded TSK: 0
I20260807 11:09:50.145632 27961 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 11:09:50.149015 27961 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260807 11:09:50.150233 27973 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: acquiring CA information for follower catalog manager: success
I20260807 11:09:50.153194 27961 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260807 11:09:50.158187 27973 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 11:09:50.169804 27356 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:09:50.170287 27356 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:09:50.177788 27888 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Refusing update from remote peer fda42d40a62841349371a2ca0bd85a37: Log matching property violated. Preceding OpId in replica: term: 2 index: 16. Preceding OpId from leader: term: 4 index: 24. (index mismatch)
I20260807 11:09:50.150243 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:09:50.178535 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:09:50.178624 27482 consensus_peers.cc:487] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 -> Peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Couldn't send request to peer 79d274e2557344d4a38dfb83e8438d1a. Status: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 11:09:50.179575 27953 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 16, Time since last communication: 0.000s
I20260807 11:09:50.199465 27512 master_service.cc:946] ReplaceTablet: received request to replace tablet 15bae401abfc4af89fdeb12ddde315ea from {username='slave'} at 127.0.0.1:37052
I20260807 11:09:50.201050 27513 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37052:
table { table_name: "default.Table_cc398fbd66d84034990dd646a25d8ccd" } new_table_name: "default.Table_3162e0d20d2d4ea5be08d1b23d21ffcb" modify_external_catalogs: true
I20260807 11:09:50.203898 27511 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37052:
table { table_name: "default.Table_2dcda62b2c384802b0be6b568b499c9e" } modify_external_catalogs: true
I20260807 11:09:50.202773 27510 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37052:
name: "default.Table_5f08f5483b4e4b69af546b339cc1f064"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:50.204756 27511 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37052:
table { table_name: "default.Table_2dcda62b2c384802b0be6b568b499c9e" } modify_external_catalogs: true
I20260807 11:09:50.203290 27516 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37052:
table { table_name: "default.Table_cef4ae08a7e64e10aa23c07621f7983b" } new_table_name: "default.Table_cc7b52ebb5b8493d8a72b9e9073d6cfa" modify_external_catalogs: true
I20260807 11:09:50.210649 27503 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37052:
name: "default.Table_937417113ef94762a2763376d99a2f2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:50.212613 27502 master_service.cc:946] ReplaceTablet: received request to replace tablet 15bae401abfc4af89fdeb12ddde315ea from {username='slave'} at 127.0.0.1:37052
I20260807 11:09:50.203622 27508 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37052:
name: "default.Table_9d2e3b5c1bee4b7aa5ed25dbeec04f42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 11:09:50.214457 27495 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37052:
name: "default.Table_54143a9db286438995e80f4662d9c52b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260807 11:09:50.215476 27606 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_7c2b24407f7e4d128d948b0dde1601f7
*** Check failure stack trace: ***
@ 0x7fc155eca9a0 google::LogMessage::Flush() at ??:0
I20260807 11:09:50.262318 27262 heartbeater.cc:347] Connected to a master server at 127.22.115.254:33273
I20260807 11:09:50.266973 27979 mvcc.cc:205] Tried to move back new op lower bound from 7315869636601806848 to 7315869634979102720. Current Snapshot: MvccSnapshot[applied={T|T < 7315869636601806848 or (T in {7315869636601806848})}]
@ 0x7fc155eca70f google::LogMessage::~LogMessage() at ??:0
I20260807 11:09:50.283207 27938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda42d40a62841349371a2ca0bd85a37. Latest consensus state: current_term: 4 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:50.283900 27938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:50.287498 27983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:50.288344 27983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:50.289541 27953 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:50.290319 27953 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37 [sys.catalog]: This master's current role is: LEADER
I20260807 11:09:50.298648 27872 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" instance_seqno: 1786100981453406) as {username='slave'} at 127.22.115.195:38765; Asking this server to re-register.
I20260807 11:09:50.303853 27262 heartbeater.cc:464] Registering TS with master...
@ 0x7fc160f65aea kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260807 11:09:50.313673 26860 heartbeater.cc:347] Connected to a master server at 127.22.115.254:33273
I20260807 11:09:50.320564 27938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "fda42d40a62841349371a2ca0bd85a37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } } }
I20260807 11:09:50.322090 27938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 11:09:50.323589 27871 ts_manager.cc:194] Registered new tserver with Master: 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:50.325840 27872 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "8309fc2e61b043479ade345c383361cc" instance_seqno: 1786100977609659) as {username='slave'} at 127.22.115.193:55395; Asking this server to re-register.
I20260807 11:09:50.327450 26860 heartbeater.cc:464] Registering TS with master...
I20260807 11:09:50.331929 27872 ts_manager.cc:194] Registered new tserver with Master: 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907)
I20260807 11:09:50.332050 27512 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fda42d40a62841349371a2ca0bd85a37: Sending DeleteTablet for 3 replicas of tablet 15bae401abfc4af89fdeb12ddde315ea
I20260807 11:09:50.341881 27512 catalog_manager.cc:6565] ReplaceTablet: tablet 15bae401abfc4af89fdeb12ddde315ea deleted and replaced by tablet 59ed5798c6a0433881ff4dd391a92b8e
I20260807 11:09:50.354141 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 15bae401abfc4af89fdeb12ddde315ea with delete_type TABLET_DATA_DELETED (replaced by tablet 59ed5798c6a0433881ff4dd391a92b8e) from {username='slave'} at 127.0.0.1:52112
I20260807 11:09:50.370594 26967 tablet_service.cc:1467] Processing CreateTablet for tablet 59ed5798c6a0433881ff4dd391a92b8e (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:50.372076 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ed5798c6a0433881ff4dd391a92b8e. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc160f6533c kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260807 11:09:50.388868 28007 tablet_replica.cc:330] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: stopping tablet replica
I20260807 11:09:50.389652 28007 raft_consensus.cc:2229] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 11:09:50.390712 28007 raft_consensus.cc:2258] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:50.400599 28007 ts_tablet_manager.cc:1905] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:50.405021 27167 tablet_service.cc:1514] Processing DeleteTablet for tablet 15bae401abfc4af89fdeb12ddde315ea with delete_type TABLET_DATA_DELETED (replaced by tablet 59ed5798c6a0433881ff4dd391a92b8e) from {username='slave'} at 127.0.0.1:46898
@ 0x7fc160f68fd2 kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260807 11:09:50.406756 27170 tablet_service.cc:1467] Processing CreateTablet for tablet 59ed5798c6a0433881ff4dd391a92b8e (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:50.408152 27170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ed5798c6a0433881ff4dd391a92b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 11:09:50.418668 26756 tablet_service.cc:1514] Processing DeleteTablet for tablet 15bae401abfc4af89fdeb12ddde315ea with delete_type TABLET_DATA_DELETED (replaced by tablet 59ed5798c6a0433881ff4dd391a92b8e) from {username='slave'} at 127.0.0.1:47832
I20260807 11:09:50.420199 26754 tablet_service.cc:1467] Processing CreateTablet for tablet 59ed5798c6a0433881ff4dd391a92b8e (DEFAULT_TABLE table=default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 11:09:50.421301 26754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ed5798c6a0433881ff4dd391a92b8e. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc160f68f8a _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
I20260807 11:09:50.450358 28012 tablet_replica.cc:330] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: stopping tablet replica
I20260807 11:09:50.451164 28012 raft_consensus.cc:2229] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:50.451655 28012 raft_consensus.cc:2258] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:50.453539 28012 ts_tablet_manager.cc:1905] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:50.463166 28010 tablet_replica.cc:330] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: stopping tablet replica
I20260807 11:09:50.464485 28009 tablet_bootstrap.cc:492] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3: Bootstrap starting.
@ 0x7fc160f68f1a std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260807 11:09:50.475520 28014 tablet_bootstrap.cc:492] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8: Bootstrap starting.
I20260807 11:09:50.476123 28010 raft_consensus.cc:2229] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 11:09:50.476831 28010 raft_consensus.cc:2258] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 11:09:50.479271 28010 ts_tablet_manager.cc:1905] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 11:09:50.485711 28009 tablet_bootstrap.cc:654] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:50.487843 28016 tablet_bootstrap.cc:492] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc: Bootstrap starting.
@ 0x7fc160f68ee2 std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260807 11:09:50.506656 28014 tablet_bootstrap.cc:654] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:50.509680 28016 tablet_bootstrap.cc:654] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc: Neither blocks nor log segments found. Creating new log.
I20260807 11:09:50.519268 28007 ts_tablet_manager.cc:1918] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:50.519732 28007 log.cc:1196] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-1/wal/wals/15bae401abfc4af89fdeb12ddde315ea
I20260807 11:09:50.520655 28007 ts_tablet_manager.cc:1939] T 15bae401abfc4af89fdeb12ddde315ea P e13176e9c2f34e6087bc6b57aac0ade3: Deleting consensus metadata
@ 0x7fc160f681de std::__1::__function::__func<>::operator()() at ??:0
I20260807 11:09:50.531704 28016 tablet_bootstrap.cc:492] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc: No bootstrap required, opened a new log
I20260807 11:09:50.531745 28014 tablet_bootstrap.cc:492] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8: No bootstrap required, opened a new log
I20260807 11:09:50.532105 28016 ts_tablet_manager.cc:1397] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.017s
I20260807 11:09:50.532204 28014 ts_tablet_manager.cc:1397] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.003s
I20260807 11:09:50.534428 28016 raft_consensus.cc:348] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:50.535127 28016 raft_consensus.cc:374] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:50.535367 28016 raft_consensus.cc:729] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Initialized, Role: FOLLOWER
I20260807 11:09:50.536024 28014 raft_consensus.cc:348] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:50.536876 28014 raft_consensus.cc:374] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:50.537163 28014 raft_consensus.cc:729] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db2a74f0f644f409db457a35ecf95e8, State: Initialized, Role: FOLLOWER
I20260807 11:09:50.537871 28014 consensus_queue.cc:260] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:50.537966 28016 consensus_queue.cc:260] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:50.540216 28014 ts_tablet_manager.cc:1428] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 11:09:50.540520 27258 heartbeater.cc:503] Master 127.22.115.252:37249 was elected leader, sending a full tablet report...
@ 0x580785 std::__1::__function::__value_func<>::operator()() at ??:?
I20260807 11:09:50.542881 28009 tablet_bootstrap.cc:492] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3: No bootstrap required, opened a new log
I20260807 11:09:50.543309 28009 ts_tablet_manager.cc:1397] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3: Time spent bootstrapping tablet: real 0.079s user 0.012s sys 0.000s
@ 0x5805ba std::__1::function<>::operator()() at ??:?
I20260807 11:09:50.549180 27485 catalog_manager.cc:4841] TS e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): tablet 15bae401abfc4af89fdeb12ddde315ea (table default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]) successfully deleted
I20260807 11:09:50.545912 28009 raft_consensus.cc:348] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:50.559159 27512 master_service.cc:946] ReplaceTablet: received request to replace tablet 59ed5798c6a0433881ff4dd391a92b8e from {username='slave'} at 127.0.0.1:37052
I20260807 11:09:50.559212 28009 raft_consensus.cc:374] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 11:09:50.559485 28009 raft_consensus.cc:729] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13176e9c2f34e6087bc6b57aac0ade3, State: Initialized, Role: FOLLOWER
I20260807 11:09:50.561353 28009 consensus_queue.cc:260] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
@ 0x7fc15807bdc7 kudu::Thread::SuperviseThread() at ??:0
@ 0x4230f0 __tsan_thread_start_func at ??:?
I20260807 11:09:50.562780 28012 ts_tablet_manager.cc:1918] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:50.567114 28012 log.cc:1196] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-0/wal/wals/15bae401abfc4af89fdeb12ddde315ea
I20260807 11:09:50.567984 28012 ts_tablet_manager.cc:1939] T 15bae401abfc4af89fdeb12ddde315ea P 8309fc2e61b043479ade345c383361cc: Deleting consensus metadata
I20260807 11:09:50.576036 27872 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" instance_seqno: 1786100979621039) as {username='slave'} at 127.22.115.194:46361; Asking this server to re-register.
I20260807 11:09:50.579025 28009 ts_tablet_manager.cc:1428] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
I20260807 11:09:50.580237 27494 master_service.cc:946] ReplaceTablet: received request to replace tablet 4425d9ee4e1c4d3385a8e9a516c50ff2 from {username='slave'} at 127.0.0.1:37052
I20260807 11:09:50.583664 27485 catalog_manager.cc:4841] TS 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): tablet 15bae401abfc4af89fdeb12ddde315ea (table default.table_2dcda62b2c384802b0be6b568b499c9e [id=ae47e05dfffa4cc6b1cfedecbc7db2c2]) successfully deleted
I20260807 11:09:50.584627 27068 heartbeater.cc:464] Registering TS with master...
@ 0x7fc1596e96db start_thread at ??:0
I20260807 11:09:50.586229 28010 ts_tablet_manager.cc:1918] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260807 11:09:50.586624 28010 log.cc:1196] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: Deleting WAL directory at /tmp/dist-test-taskijOH_9/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786100904577792-22991-0/minicluster-data/ts-2/wal/wals/15bae401abfc4af89fdeb12ddde315ea
I20260807 11:09:50.587551 28010 ts_tablet_manager.cc:1939] T 15bae401abfc4af89fdeb12ddde315ea P 2db2a74f0f644f409db457a35ecf95e8: Deleting consensus metadata
I20260807 11:09:50.592530 27872 ts_manager.cc:194] Registered new tserver with Master: e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
@ 0x7fc154b6f61f clone at ??:0
I20260807 11:09:50.608428 26852 heartbeater.cc:503] Master 127.22.115.252:37249 was elected leader, sending a full tablet report...
I20260807 11:09:50.621519 28016 ts_tablet_manager.cc:1428] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc: Time spent starting tablet: real 0.089s user 0.013s sys 0.001s
I20260807 11:09:50.810473 28025 raft_consensus.cc:482] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:50.810999 28025 raft_consensus.cc:504] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:50.812882 28025 leader_election.cc:288] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:50.814211 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ed5798c6a0433881ff4dd391a92b8e" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" is_pre_election: true
I20260807 11:09:50.814656 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ed5798c6a0433881ff4dd391a92b8e" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8" is_pre_election: true
I20260807 11:09:50.814951 26996 raft_consensus.cc:2454] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8309fc2e61b043479ade345c383361cc in term 0.
I20260807 11:09:50.815415 27198 raft_consensus.cc:2454] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8309fc2e61b043479ade345c383361cc in term 0.
I20260807 11:09:50.816227 26682 leader_election.cc:302] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:50.817191 28025 raft_consensus.cc:2781] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 11:09:50.817551 28025 raft_consensus.cc:482] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 11:09:50.817853 28025 raft_consensus.cc:3037] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:50.824764 28025 raft_consensus.cc:504] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
I20260807 11:09:50.827955 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ed5798c6a0433881ff4dd391a92b8e" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e13176e9c2f34e6087bc6b57aac0ade3"
I20260807 11:09:50.828164 27198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ed5798c6a0433881ff4dd391a92b8e" candidate_uuid: "8309fc2e61b043479ade345c383361cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2db2a74f0f644f409db457a35ecf95e8"
I20260807 11:09:50.828559 26996 raft_consensus.cc:3037] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:50.828660 27198 raft_consensus.cc:3037] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 11:09:50.834554 27198 raft_consensus.cc:2454] T 59ed5798c6a0433881ff4dd391a92b8e P 2db2a74f0f644f409db457a35ecf95e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8309fc2e61b043479ade345c383361cc in term 1.
I20260807 11:09:50.835767 26996 raft_consensus.cc:2454] T 59ed5798c6a0433881ff4dd391a92b8e P e13176e9c2f34e6087bc6b57aac0ade3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8309fc2e61b043479ade345c383361cc in term 1.
I20260807 11:09:50.827476 28025 leader_election.cc:288] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 election: Requested vote from peers e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309), 2db2a74f0f644f409db457a35ecf95e8 (127.22.115.195:33411)
I20260807 11:09:50.836959 26682 leader_election.cc:302] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3; no voters:
I20260807 11:09:50.837761 28025 raft_consensus.cc:2781] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 11:09:50.838203 28025 raft_consensus.cc:686] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [term 1 LEADER]: Becoming Leader. State: Replica: 8309fc2e61b043479ade345c383361cc, State: Running, Role: LEADER
I20260807 11:09:50.838948 28025 consensus_queue.cc:237] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } } peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } }
W20260807 11:09:50.881829 27108 connection.cc:535] server connection from 127.0.0.1:46898 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:50.882695 27105 connection.cc:535] client connection to 127.22.115.252:37249 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 11:09:50.884322 27273 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.22.115.252:37249)
W20260807 11:09:50.885530 27273 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.115.252:37249)
W20260807 11:09:50.887598 27273 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.22.115.252:37249)
W20260807 11:09:50.888296 27273 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.22.115.252:37249)
W20260807 11:09:50.889072 27985 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 11:09:50.885613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.115.252:37249 (local address 127.22.115.195:56815)
0807 11:09:50.887316 (+ 1703us) negotiation.cc:107] Waiting for socket to connect
0807 11:09:50.887381 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 11:09:50.887616 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 11:09:50.887976 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1280}
W20260807 11:09:50.891048 26681 connection.cc:535] client connection to 127.22.115.252:37249 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 11:09:51.096036 28034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:51.096433 28034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:51.098819 28034 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:51.100582 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:51.107223 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:51.107908 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:51.108223 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:51.108793 28034 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:51.743407 27870 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:51.743929 27870 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:51.745548 27870 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:09:51.747396 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:09:51.747996 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:09:51.748271 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:09:51.748863 27870 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:51.814827 28043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:51.815279 28043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:51.816942 28043 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:51.825248 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:51.825749 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:51.826114 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:51.826700 28043 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:51.944317 28048 consensus_queue.cc:1035] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:51.962252 28048 consensus_queue.cc:1035] T 59ed5798c6a0433881ff4dd391a92b8e P 8309fc2e61b043479ade345c383361cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 11:09:52.411762 28069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:52.412134 28069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:52.413650 28069 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:52.417878 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:52.418345 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:52.418689 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:52.419238 28069 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:52.638643 22991 master-stress-test.cc:578] Killing test thread 1/10
I20260807 11:09:54.068720 28109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:54.069100 28109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:54.070621 28109 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:54.074823 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:54.075305 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:54.075821 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:54.076457 28109 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:09:54.321460 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 6: this message will repeat every 5th retry.
I20260807 11:09:55.183878 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:09:55.184221 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:09:56.210893 28163 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:56.211258 28163 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:56.212813 28163 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:56.214715 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:56.214715 27851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260807 11:09:56.217640 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:56.217973 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:56.218269 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:56.218776 28163 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:09:58.082558 28179 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:09:58.083019 28179 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:09:58.084512 28179 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:09:58.086256 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:09:58.086751 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:09:58.087039 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:09:58.087553 28179 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:09:58.664103 28212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:09:58.664660 28212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:09:58.666467 28212 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:09:58.672461 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:09:58.673056 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:09:58.673453 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:09:58.674203 28212 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:10:00.189626 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:00.190006 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:02.120491 28296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:10:02.120890 28296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:10:02.122560 28296 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:10:02.124122 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260807 11:10:02.126801 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:10:02.127329 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:10:02.127756 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:10:02.128304 28296 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:10:02.538965 28308 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:10:02.539510 28308 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:10:02.541807 28308 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:10:02.543515 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:10:02.544199 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:10:02.544603 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:10:02.545607 28308 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:10:04.879957 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 11: this message will repeat every 5th retry.
I20260807 11:10:05.195092 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:05.195428 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:07.324044 28424 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:10:07.324481 28424 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:10:07.325891 28424 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:10:07.327603 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:10:07.328091 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:10:07.328336 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:10:07.328833 28424 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:10:10.106591 28496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:10:10.107264 28496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:10:10.108974 28496 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:10:10.111330 27851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260807 11:10:10.114168 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:10:10.114719 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:10:10.115092 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:10:10.115695 28496 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:10:10.200145 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:10.200517 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:10:14.723338 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 16: this message will repeat every 5th retry.
I20260807 11:10:15.205256 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:15.205582 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:19.985028 28692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:10:19.985548 28692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:10:19.987157 28692 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:10:19.989151 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:10:19.991727 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:10:19.992197 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:10:19.992489 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:10:19.993029 28692 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:10:20.210162 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:20.210569 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:22.055531 28722 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:10:22.056031 28722 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:10:22.058162 28722 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:10:22.059930 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:10:22.060475 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:10:22.060750 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:10:22.061254 28722 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:10:24.150786 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 21: this message will repeat every 5th retry.
I20260807 11:10:25.215610 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:25.215937 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:25.728801 28807 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:10:25.729179 28807 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:10:25.730597 28807 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:10:25.732090 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:10:25.732592 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:10:25.732805 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:10:25.733259 28807 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:10:28.017764 28856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:10:28.018234 28856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:10:28.019773 28856 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:10:28.021318 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:10:28.024062 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:10:28.024446 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:10:28.024755 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:10:28.025293 28856 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:10:30.221716 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:30.222227 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:10:33.854803 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 26: this message will repeat every 5th retry.
I20260807 11:10:35.232731 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:35.233225 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:40.238797 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:40.239244 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:10:41.875849 27065 heartbeater.cc:644] Failed to heartbeat to 127.22.115.253:45313 (143 consecutive failures): Network error: Failed to ping master at 127.22.115.253:45313: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:10:41.886024 29144 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:10:41.886600 29144 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:10:41.888792 29144 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:10:41.890296 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:10:41.890818 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:10:41.891094 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:10:41.891553 29144 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:10:42.245913 26852 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (105 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:10:42.276114 27259 heartbeater.cc:644] Failed to heartbeat to 127.22.115.253:45313 (119 consecutive failures): Network error: Failed to ping master at 127.22.115.253:45313: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:10:43.775439 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000e92e0 after lost signal to thread 27080
W20260807 11:10:43.776356 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000dabc0 after lost signal to thread 27257
W20260807 11:10:43.841743 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 31: this message will repeat every 5th retry.
I20260807 11:10:44.273178 29206 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:10:44.273636 29206 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:10:44.275710 29206 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:10:44.277796 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:10:44.281793 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:10:44.282271 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:10:44.282605 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:10:44.283126 29206 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:10:45.244489 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:45.244845 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:50.342690 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:50.343165 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:10:50.369882 27914 debug-util.cc:398] Leaking SignalData structure 0x7b080008dec0 after lost signal to thread 27780
W20260807 11:10:50.370424 27914 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2960 after lost signal to thread 27921
I20260807 11:10:52.290565 29403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:10:52.291045 29403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:10:52.292760 29403 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:10:52.294875 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:10:52.297482 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:10:52.297840 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:10:52.298125 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:10:52.298633 29403 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:10:52.460172 27057 debug-util.cc:398] Leaking SignalData structure 0x7b08000db560 after lost signal to thread 26869
W20260807 11:10:52.461138 27057 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1240 after lost signal to thread 27061
W20260807 11:10:53.415603 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 36: this message will repeat every 5th retry.
I20260807 11:10:55.347760 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:10:55.348096 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:10:57.401054 29503 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:10:57.401769 29503 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:10:57.404363 29503 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:10:57.406035 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:10:57.406538 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:10:57.406780 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:10:57.407325 29503 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:10:58.752877 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000db780 after lost signal to thread 26644
W20260807 11:10:58.753917 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6060 after lost signal to thread 26851
I20260807 11:11:00.354391 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:00.354990 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:11:02.827831 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 41: this message will repeat every 5th retry.
I20260807 11:11:03.098052 29633 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:03.098585 29633 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:03.100507 29633 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:03.101956 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:03.102421 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:03.102629 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:03.103171 29633 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:11:03.404858 29649 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:11:03.405354 29649 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:11:03.406930 29649 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:11:03.409060 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:11:03.411532 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:11:03.411979 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:11:03.412235 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:11:03.412822 29649 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:11:05.360152 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:05.360494 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:11:10.365921 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:10.366338 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:11:12.267788 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 46: this message will repeat every 5th retry.
I20260807 11:11:15.371515 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:15.371866 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:11:16.174767 29953 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:16.175287 29953 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:16.177448 29953 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:16.178921 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:16.179406 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:16.179651 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:16.180143 29953 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:11:17.689143 27057 debug-util.cc:398] Leaking SignalData structure 0x7b080006f180 after lost signal to thread 26869
W20260807 11:11:17.689998 27057 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc340 after lost signal to thread 27061
I20260807 11:11:18.688153 30024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:11:18.688737 30024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:11:18.691474 30024 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:11:18.693799 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:11:18.696713 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:11:18.697657 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:11:18.697919 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:11:18.698467 30024 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:11:20.377065 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:20.377566 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:11:23.021322 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 51: this message will repeat every 5th retry.
I20260807 11:11:23.129515 30142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:11:23.129884 30142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:11:23.131367 30142 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:11:23.135203 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:11:23.135522 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:11:23.135795 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:11:23.136246 30142 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:11:25.382632 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:25.383021 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:11:25.551602 30213 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:11:25.552039 30213 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:11:25.553526 30213 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:11:25.554450 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260807 11:11:25.557020 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:11:25.557341 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:11:25.557613 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:11:25.558092 30213 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:11:27.318831 30256 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:27.319379 30256 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:27.321015 30256 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:27.322726 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:27.323223 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:27.323441 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:27.323949 30256 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:11:30.388432 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:30.389019 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:11:32.997793 30395 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:32.998411 30395 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:33.000694 30395 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:33.002183 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:33.002653 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:33.002918 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:33.003403 30395 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:11:33.631322 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 56: this message will repeat every 5th retry.
I20260807 11:11:35.394281 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:35.394639 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:11:37.110659 30495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:11:37.111203 30495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:11:37.112886 30495 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:11:37.114717 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:11:37.117604 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:11:37.118018 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:11:37.118301 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:11:37.118791 30495 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:11:40.400502 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:40.400954 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:11:41.969980 27063 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (276 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:11:42.621558 26852 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (225 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:11:42.719477 27258 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (225 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:11:43.601387 30666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:11:43.601827 30666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:11:43.603487 30666 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:11:43.605365 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:11:43.608114 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:11:43.608501 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:11:43.608786 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:11:43.609298 30666 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:11:43.943078 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 61: this message will repeat every 5th retry.
W20260807 11:11:45.091774 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000460c0 after lost signal to thread 27080
W20260807 11:11:45.092633 27252 debug-util.cc:398] Leaking SignalData structure 0x7b0800085540 after lost signal to thread 27257
I20260807 11:11:45.415542 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:45.415956 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:11:46.411667 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000c16a0 after lost signal to thread 27080
W20260807 11:11:46.412642 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000e0120 after lost signal to thread 27257
W20260807 11:11:47.529508 27252 debug-util.cc:398] Leaking SignalData structure 0x7b0800040900 after lost signal to thread 27080
W20260807 11:11:47.530339 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000ddd80 after lost signal to thread 27257
I20260807 11:11:48.184324 30790 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:48.184809 30790 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:48.186740 30790 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:48.188247 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:48.188814 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:48.189064 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:48.189577 30790 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:11:50.124223 27855 maintenance_manager.cc:419] P 6ef9afb7003a447087f387b3eab9ee86: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033354
I20260807 11:11:50.193189 27854 maintenance_manager.cc:643] P 6ef9afb7003a447087f387b3eab9ee86: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.068s user 0.028s sys 0.022s Metrics: {"bytes_written":9674,"cfile_init":1,"drs_written":1,"lbm_read_time_us":199,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2518,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":15,"thread_start_us":454,"threads_started":1,"wal-append.queue_time_us":758}
I20260807 11:11:50.195561 27855 maintenance_manager.cc:419] P 6ef9afb7003a447087f387b3eab9ee86: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 901 bytes on disk
I20260807 11:11:50.197207 27854 maintenance_manager.cc:643] P 6ef9afb7003a447087f387b3eab9ee86: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":254,"lbm_reads_lt_1ms":4}
W20260807 11:11:50.367518 27057 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5ce0 after lost signal to thread 26869
W20260807 11:11:50.368439 27057 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc300 after lost signal to thread 27061
I20260807 11:11:50.424526 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:50.425016 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:11:52.378297 30920 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:52.378823 30920 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:52.380613 30920 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:52.382067 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:52.382619 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:52.382891 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:52.383412 30920 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:11:53.608650 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 66: this message will repeat every 5th retry.
I20260807 11:11:55.430236 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:11:55.430593 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:11:55.577627 30995 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:55.578043 30995 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:55.579542 30995 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:55.580962 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:55.581504 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:55.581736 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:55.582238 30995 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:11:58.270025 31084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:11:58.270510 31084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:11:58.272122 31084 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:11:58.274119 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:11:58.276675 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:11:58.277099 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:11:58.277388 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:11:58.277956 31084 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:11:58.851477 31103 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:11:58.851928 31103 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:11:58.853679 31103 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:11:58.855285 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:11:58.855719 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:11:58.855940 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:11:58.856415 31103 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:12:00.436542 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:00.436988 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:12:03.513736 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 71: this message will repeat every 5th retry.
I20260807 11:12:05.441460 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:05.441782 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:12:06.158751 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000da580 after lost signal to thread 26644
W20260807 11:12:06.160125 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3fc0 after lost signal to thread 26851
I20260807 11:12:08.433320 31375 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:12:08.433868 31375 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:12:08.436019 31375 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:12:08.437681 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:12:08.438342 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:12:08.438660 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:12:08.439234 31375 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:12:08.774827 31415 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:12:08.775815 31415 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:12:08.778765 31415 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:12:08.782232 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:12:08.785228 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:12:08.785705 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:12:08.786080 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:12:08.786755 31415 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:12:10.446977 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:10.447358 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:12:12.309764 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000d7380 after lost signal to thread 26644
W20260807 11:12:12.310577 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000da940 after lost signal to thread 26851
I20260807 11:12:13.895831 31575 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:12:13.896337 31575 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:12:13.897956 31575 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:12:13.899454 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:12:13.899952 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:12:13.900173 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:12:13.900679 31575 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:12:14.073578 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 76: this message will repeat every 5th retry.
I20260807 11:12:15.452728 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:15.453161 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:12:16.933141 31629 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:12:16.933560 31629 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:12:16.935158 31629 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:12:16.936657 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:12:16.937144 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:12:16.937377 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:12:16.937875 31629 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:12:20.459339 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:20.459903 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:12:22.548161 31809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:12:22.548650 31809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:12:22.550329 31809 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:12:22.552529 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:12:22.555471 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:12:22.555928 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:12:22.556221 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:12:22.556748 31809 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:12:23.131716 31842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:12:23.132087 31842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:12:23.133569 31842 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:12:23.138777 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:12:23.139189 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:12:23.139493 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:12:23.139952 31842 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:12:24.044744 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 81: this message will repeat every 5th retry.
I20260807 11:12:25.464574 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:25.464941 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:12:26.296384 31935 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:12:26.296912 31935 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:12:26.299101 31935 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:12:26.300731 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:12:26.301249 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:12:26.301498 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:12:26.302003 31935 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:12:30.471027 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:30.471484 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:12:34.448359 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 86: this message will repeat every 5th retry.
I20260807 11:12:35.107317 32199 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:12:35.107757 32199 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:12:35.109333 32199 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:12:35.111279 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260807 11:12:35.113770 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:12:35.114180 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:12:35.114497 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:12:35.115008 32199 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:12:35.476089 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:35.476550 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:12:39.167352 32284 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:12:39.167904 32284 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:12:39.169644 32284 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:12:39.171324 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:12:39.171788 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:12:39.172008 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:12:39.172477 32284 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:12:40.482194 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:40.482610 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:12:41.618355 32406 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:12:41.618907 32406 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:12:41.620445 32406 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:12:41.622730 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:12:41.625205 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:12:41.625573 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:12:41.625851 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:12:41.626360 32406 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:12:42.071534 27065 heartbeater.cc:644] Failed to heartbeat to 127.22.115.253:45313 (439 consecutive failures): Network error: Failed to ping master at 127.22.115.253:45313: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:12:43.022648 26852 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (345 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:12:43.096601 27259 heartbeater.cc:644] Failed to heartbeat to 127.22.115.253:45313 (359 consecutive failures): Network error: Failed to ping master at 127.22.115.253:45313: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:12:44.938323 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 91: this message will repeat every 5th retry.
I20260807 11:12:45.487533 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:45.487934 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:12:50.044564 27914 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba480 after lost signal to thread 27780
W20260807 11:12:50.045096 27914 debug-util.cc:398] Leaking SignalData structure 0x7b080009e300 after lost signal to thread 27921
I20260807 11:12:50.517470 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:50.517846 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:12:51.361656 32702 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:12:51.362221 32702 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:12:51.365408 32702 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:12:51.366398 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:12:51.366897 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:12:51.367136 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:12:51.368175 32702 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:12:54.826421 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 96: this message will repeat every 5th retry.
I20260807 11:12:55.522487 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:12:55.522874 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:12:55.927815 329 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:12:55.928222 329 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:12:55.929701 329 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:12:55.931160 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:12:55.931612 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:12:55.931829 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:12:55.932279 329 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:13:00.528193 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:00.528616 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:00.602037 468 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:13:00.602535 468 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:13:00.604477 468 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:13:00.605551 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:13:00.608485 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:13:00.609463 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:13:00.609723 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:13:00.610239 468 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:13:02.740856 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9fe0 after lost signal to thread 26644
W20260807 11:13:02.741741 26847 debug-util.cc:398] Leaking SignalData structure 0x7b0800041aa0 after lost signal to thread 26851
W20260807 11:13:04.790099 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 101: this message will repeat every 5th retry.
I20260807 11:13:05.533437 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:05.533779 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:13:07.401201 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5580 after lost signal to thread 27080
W20260807 11:13:07.402127 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd400 after lost signal to thread 27257
I20260807 11:13:10.539299 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:10.539716 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:11.171639 700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:13:11.172115 700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:13:11.173727 700 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:13:11.175841 27851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:13:11.178321 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:13:11.178756 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:13:11.179076 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:13:11.179591 700 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:13:13.781811 778 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:13:13.782541 778 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:13:13.784829 778 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:13:13.786530 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:13:13.787122 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:13:13.787395 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:13:13.787921 778 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:13:15.544507 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:15.544894 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:13:15.660562 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 106: this message will repeat every 5th retry.
W20260807 11:13:17.052222 27057 debug-util.cc:398] Leaking SignalData structure 0x7b0800043520 after lost signal to thread 26869
W20260807 11:13:17.053020 27057 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3580 after lost signal to thread 27061
W20260807 11:13:19.338729 27252 debug-util.cc:398] Leaking SignalData structure 0x7b0800042060 after lost signal to thread 27080
W20260807 11:13:19.339629 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000e44e0 after lost signal to thread 27257
I20260807 11:13:20.550321 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:20.550753 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:25.556010 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:25.556406 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:25.635083 1141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:13:25.635581 1141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:13:25.637341 1141 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:13:25.638672 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:13:25.641454 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:13:25.642081 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:13:25.642361 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:13:25.642942 1141 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:13:25.766072 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 111: this message will repeat every 5th retry.
I20260807 11:13:30.540642 1279 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:13:30.541288 1279 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:13:30.543789 1279 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:13:30.545229 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:13:30.545707 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:13:30.545949 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:13:30.546480 1279 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:13:30.561815 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:30.562255 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:35.567417 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:35.567790 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:13:35.625881 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 116: this message will repeat every 5th retry.
I20260807 11:13:40.572904 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:40.573315 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:42.170738 1632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:13:42.171276 1632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:13:42.173316 1632 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:13:42.175350 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:13:42.177784 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:13:42.178184 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:13:42.178514 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:13:42.179039 1632 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:13:42.405751 27063 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (571 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:13:42.639182 26847 debug-util.cc:398] Leaking SignalData structure 0x7b0800043600 after lost signal to thread 26644
W20260807 11:13:42.640059 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3a00 after lost signal to thread 26851
W20260807 11:13:43.374876 26853 heartbeater.cc:644] Failed to heartbeat to 127.22.115.253:45313 (481 consecutive failures): Network error: Failed to ping master at 127.22.115.253:45313: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:13:43.381331 1682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:13:43.381716 1682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:13:43.383352 1682 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:13:43.388121 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:13:43.388463 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:13:43.388737 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:13:43.389221 1682 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:13:43.443264 27258 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (465 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:13:45.327271 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 121: this message will repeat every 5th retry.
I20260807 11:13:45.578308 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:45.578612 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:48.143195 1838 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:13:48.143708 1838 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:13:48.145612 1838 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:13:48.147203 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:13:48.147679 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:13:48.147934 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:13:48.148434 1838 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:13:50.584517 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:50.584890 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:13:53.154300 1984 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:13:53.155062 1984 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:13:53.157117 1984 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:13:53.158771 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:13:53.159301 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:13:53.159566 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:13:53.160106 1984 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:13:55.589458 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:13:55.589767 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:13:55.810034 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 126: this message will repeat every 5th retry.
I20260807 11:13:57.478771 2119 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:13:57.479286 2119 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:13:57.480854 2119 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:13:57.483040 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260807 11:13:57.485816 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:13:57.486377 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:13:57.486672 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:13:57.487231 2119 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:14:00.595490 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:00.595916 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:01.245299 2222 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:14:01.246013 2222 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:14:01.248270 2222 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:14:01.249902 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:14:01.250532 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:14:01.250881 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:14:01.251513 2222 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:14:03.864827 27914 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1b20 after lost signal to thread 27780
W20260807 11:14:03.865383 27914 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd9c0 after lost signal to thread 27921
W20260807 11:14:04.900434 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000d00a0 after lost signal to thread 26644
W20260807 11:14:04.901276 26847 debug-util.cc:398] Leaking SignalData structure 0x7b08000b31a0 after lost signal to thread 26851
I20260807 11:14:05.632139 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:05.632467 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:14:06.368681 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 131: this message will repeat every 5th retry.
I20260807 11:14:09.168852 2437 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:14:09.169238 2437 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:14:09.171267 2437 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:14:09.172638 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:14:09.173118 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:14:09.173363 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:14:09.173813 2437 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:14:10.638325 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:10.638717 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:14:11.156368 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3820 after lost signal to thread 27080
W20260807 11:14:11.157668 27252 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7760 after lost signal to thread 27257
I20260807 11:14:12.781178 2513 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:14:12.781749 2513 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:14:12.783880 2513 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:14:12.785712 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:14:12.788580 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:14:12.789101 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:14:12.789403 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:14:12.789935 2513 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:14:13.274963 27914 debug-util.cc:398] Leaking SignalData structure 0x7b080009e140 after lost signal to thread 27780
W20260807 11:14:13.275532 27914 debug-util.cc:398] Leaking SignalData structure 0x7b080009de20 after lost signal to thread 27921
I20260807 11:14:15.667002 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:15.667387 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 11:14:16.430044 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 136: this message will repeat every 5th retry.
I20260807 11:14:20.672217 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:20.672598 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:25.677362 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:25.677675 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:26.058319 2822 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:14:26.058835 2822 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:14:26.061189 2822 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:14:26.063107 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:14:26.063627 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:14:26.063879 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:14:26.064359 2822 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:14:27.088266 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 141: this message will repeat every 5th retry.
I20260807 11:14:27.163784 2858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:14:27.164222 2858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:14:27.165797 2858 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:14:27.168076 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:14:27.171037 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:14:27.171569 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:14:27.171849 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:14:27.172365 2858 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:14:30.682924 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:30.683311 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:35.688114 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:35.688449 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:36.740083 3118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:14:36.740561 3118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:14:36.742208 3118 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:14:36.744227 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:14:36.746419 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:14:36.746778 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:14:36.747084 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:14:36.747573 3118 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:14:37.361547 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 146: this message will repeat every 5th retry.
I20260807 11:14:40.694273 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:40.694694 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:41.730156 3242 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:14:41.730685 3242 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:14:41.732890 3242 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:14:41.734512 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:14:41.735013 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:14:41.735241 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:14:41.735711 3242 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 11:14:42.000612 3264 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:14:42.001279 3264 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:14:42.002820 3264 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:14:42.004731 27848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260807 11:14:42.007198 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:14:42.007527 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
I20260807 11:14:42.007808 27848 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:14:42.008328 3264 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 11:14:42.748378 27063 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (725 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:14:43.751104 26852 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (585 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
W20260807 11:14:43.801910 27258 heartbeater.cc:644] Failed to heartbeat to 127.22.115.252:37249 (585 consecutive failures): Network error: Failed to ping master at 127.22.115.252:37249: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:14:45.699276 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:45.699628 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:46.205303 3392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fda42d40a62841349371a2ca0bd85a37)
I20260807 11:14:46.205694 3392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9afb7003a447087f387b3eab9ee86" member_type: VOTER last_known_addr { host: "127.22.115.254" port: 33273 } } peers { permanent_uuid: "79d274e2557344d4a38dfb83e8438d1a" member_type: VOTER last_known_addr { host: "127.22.115.253" port: 45313 } } peers { permanent_uuid: "fda42d40a62841349371a2ca0bd85a37" member_type: VOTER last_known_addr { host: "127.22.115.252" port: 37249 } }
I20260807 11:14:46.207193 3392 leader_election.cc:288] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313), fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249)
W20260807 11:14:46.211688 27848 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 79d274e2557344d4a38dfb83e8438d1a (127.22.115.253:45313): Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111)
W20260807 11:14:46.212078 27851 leader_election.cc:334] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fda42d40a62841349371a2ca0bd85a37 (127.22.115.252:37249): Network error: Client connection negotiation failed: client connection to 127.22.115.252:37249: connect: Connection refused (error 111)
I20260807 11:14:46.212386 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ef9afb7003a447087f387b3eab9ee86; no voters: 79d274e2557344d4a38dfb83e8438d1a, fda42d40a62841349371a2ca0bd85a37
I20260807 11:14:46.212860 3392 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ef9afb7003a447087f387b3eab9ee86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 11:14:46.440953 3407 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:14:46.441460 3407 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:14:46.443089 3407 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:14:46.444571 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:14:46.445016 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:14:46.445245 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:14:46.445717 3407 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:14:47.211179 26903 consensus_peers.cc:487] T 4493bdc609d64b5faec420679a9bef08 P e13176e9c2f34e6087bc6b57aac0ade3 -> Peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Couldn't send request to peer 8309fc2e61b043479ade345c383361cc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4493bdc609d64b5faec420679a9bef08. This is attempt 151: this message will repeat every 5th retry.
I20260807 11:14:50.607944 27855 maintenance_manager.cc:419] P 6ef9afb7003a447087f387b3eab9ee86: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 901 bytes on disk
I20260807 11:14:50.619799 27854 maintenance_manager.cc:643] P 6ef9afb7003a447087f387b3eab9ee86: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.011s user 0.007s sys 0.003s Metrics: {"dirs.queue_time_us":671,"dirs.run_cpu_time_us":257,"dirs.run_wall_time_us":258,"thread_start_us":809,"threads_started":2,"wal-append.queue_time_us":724}
I20260807 11:14:50.704659 27761 master_runner.cc:186] Error getting master registration for 127.22.115.253:45313: Network error: Client connection negotiation failed: client connection to 127.22.115.253:45313: connect: Connection refused (error 111),
I20260807 11:14:50.705029 27761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 11:14:51.043922 3522 raft_consensus.cc:482] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 11:14:51.044514 3522 raft_consensus.cc:504] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db2a74f0f644f409db457a35ecf95e8" member_type: VOTER last_known_addr { host: "127.22.115.195" port: 33411 } } peers { permanent_uuid: "8309fc2e61b043479ade345c383361cc" member_type: VOTER last_known_addr { host: "127.22.115.193" port: 33907 } } peers { permanent_uuid: "e13176e9c2f34e6087bc6b57aac0ade3" member_type: VOTER last_known_addr { host: "127.22.115.194" port: 41309 } }
I20260807 11:14:51.046307 3522 leader_election.cc:288] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907), e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309)
W20260807 11:14:51.047654 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8309fc2e61b043479ade345c383361cc (127.22.115.193:33907): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
W20260807 11:14:51.048152 27106 leader_election.cc:341] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e13176e9c2f34e6087bc6b57aac0ade3 (127.22.115.194:41309): Not found: Tablet not found: 237991fbd81a47a58865556f63bce2cf
I20260807 11:14:51.048406 27106 leader_election.cc:302] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2db2a74f0f644f409db457a35ecf95e8; no voters: 8309fc2e61b043479ade345c383361cc, e13176e9c2f34e6087bc6b57aac0ade3
I20260807 11:14:51.048933 3522 raft_consensus.cc:2726] T 237991fbd81a47a58865556f63bce2cf P 2db2a74f0f644f409db457a35ecf95e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 11:14:51.122537 27273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 1)
W20260807 11:14:51.123080 27273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 1)
W20260807 11:14:51.123387 27273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 1)
W20260807 11:14:51.123595 27273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 1)
F20260807 11:14:51.136813 27284 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 1)
F20260807 11:14:51.138598 27283 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_937417113ef94762a2763376d99a2f2d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.22.115.254:33273,127.22.115.253:45313,127.22.115.252:37249, num_attempts: 1)
*** Check failure stack trace: ***
*** Aborted at 1786101291 (unix time) try "date -d @1786101291" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** Check failure stack trace: ***
*** SIGABRT (@0x3e8000059cf) received by PID 22991 (TID 0x7fe445cfb700) from PID 22991; stack trace: ***
@ 0x2b0af0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x2b31e0 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
@ 0x7fe458004980 (unknown) at ??:0
@ 0x7fe4532c1e87 gsignal at ??:0
@ 0x7fe4532c37f1 abort at ??:0
@ 0x2b4f37 __interceptor_abort at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
@ 0x7fe4562f5df4 google::LogMessage::SendToLog() at ??:0
@ 0x7fe4562f69a0 google::LogMessage::Flush() at ??:0
@ 0x7fe4562fbadb google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3578b6 kudu::MasterStressTest::AlterTableThread() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:?
@ 0x3874ce _ZNSt3__18__invokeIMN4kudu16MasterStressTestEFvvEPNS1_26MasterStressTest_Test_TestEJEvEEDTcldsdeclsr3std3__1E7forwardIT0_Efp0_Efp_spclsr3std3__1E7forwardIT1_Efp1_EEEOT_OS7_DpOS8_ at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/type_traits:3840
@ 0x387381 _ZNSt3__116__thread_executeINS_10unique_ptrINS_15__thread_structENS_14default_deleteIS2_EEEEMN4kudu16MasterStressTestEFvvEJPNS6_26MasterStressTest_Test_TestEEJLm2EEEEvRNS_5tupleIJT_T0_DpT1_EEENS_15__tuple_indicesIJXspT2_EEEE at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:281
@ 0x386acb std::__1::__thread_proxy<>() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:?
@ 0x2b11b0 __tsan_thread_start_func at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:959
@ 0x7fe457ff96db start_thread at ??:0
@ 0x7fe4533a461f clone at ??:0